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What is the National Center for Effective Schools? 

The Center is a nol-for-profil organization formed in 1986 for the purpose of serving as a reso:iich and 
resource center, clearing house, and technical assistance base for educational professionals designing and 
implementing programs of school reform. 

Based on a planned -change educational model known as the Effective Schools Research Model, the 
Center s major objective is to provide assistance to schools in order to assure that all pupils, rcgju-dlcss of 
gender, race, or socioeconomic status, receive both a quality education and an equal opportunity to ]e:irn. 

What is the "Effective Schools Model?" 

Simply stated, the "Effective Schools Model" is a school reform framework based on evolving research 
from both empirical studies and case studies of schools across the country tlial have been effective in 
teaching the intended curriculum to all their students. 

Out of that research, two criteria for measuring effectiveness have evolved: quality and equity. The 
quality standard assures that tlie level of achievement in a school is high. The equity standard assures ih:ii 
the high achievement does not vary significantly across tlic subsets of the school's student population. Noi 
only are these criteria critical, to iJie definition of "Effective Schools." they are also the pillars on which 
the National Center's major objective has been established. 
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The Effective Schools model or process is a framework for school reform which is 
based on evolving research from both empirical investigations and case studies of 
schools across the country that have been successful in teaching the intended curriculum 
of basic skills to all their students, (Basic skills may include comprehensive reading 
skills, oral and written communication skills, computing skills, problem solving, higher 
order thinking skills, and social skills). 

In this model the individual school is viewed as the targeted unit of improvement. 
Each school, through a faculty-administrator team-planning approach, utilizes the con- 
cepts and elements of the Effective Schools process to develop and implement a long- 
range improvement plan. In addition, the model promotes district-wide restructuring for 
improvement, and to become effective requires that the district be committed to the pro- 
gram for at least three to five years. 

Two criteria for measuring effectiveness have evolved: quality and equity. Having 
a quality standard assures that the level of achievement in a school is high. Having an 
equity standard assures that the high achievement does not vary significantly across the 
subsets of the school's student population. Not only are these standards critical to the 
definition of ^'Effective Schools,'' they are fundamental when planning and implement- 
ing the Effective Schools process for school improvement. 

Two elements are key to the success of the model. First, the school must develop 
and state a school mission. Second, the school must be willing to accept the * 'Effective 
Schools" program as a comprehensive plan. Developing a school improvement plan on 
a piecemeal basis and focusing on only two or three of the characteristics 
(* 'correlates") which define an Effective School destroys the cohesiveness of the pro- 
gram and decreases the chance for significant and lasting improvement at the school. 

The five or seven characteristics of Effective Schools (see ''correlates" in the 
Glossary) which define the educational programs at these schools tend to work together 
to foster both the organizational dynamics and the context of shared values which pro- 
mote a school climate or culture conducive to teaching for learning for all. The model is 
driven by shared decision-making at the school site, which is based largely on data col- 
lected by school-wide and district-wide monitoring systems. 

The National Center for Effective Schools Research and Development uses the 
capitalized phrases ''Effective Schools Research" and "Effective Schools model or 
process" to denote the comprehensive model espoused by the National Center and 
founded upon the research literature, "Effective Schools" is a service mark (SM) of the 
National Center for Effective Schools Research & Development. 
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Case Studies in Effective Schools Research 



The National Center for Effective Schools Research and Development takes pride in presenting 
these case studies of school improvement. Each report stands on its own and is written in the language 
of the authors as they report their story of school improvement based on the Effective Schools Research 
model. The editors endeavored to keep each district's rationale intact, trying hard not to change the 
words which capture the culture, traditions, and values that undergird the educational program of each 
district. These are, indeed, case studies in the practitioner's voice. These case studies carry good news 
about the difficult but rewarding work that is associated with school improvement. 

For over a decade the people involved in school improvement programs in these districts have 
been experimenting with '*what works." In some school systems, long before the more popular buzz 
v^ords of **renewal," ^^empowerment," restructuring," and **shared decision-making" were known, 
these educators were setting up systems that could renew schools, designing new organizational ar- 
rangements and reporting structures which would empower teachers by supporting them in their work 
with students, and participating in decision-making procedures which were collaborative and shared. 

The language of the Effective Schools process for school improvement is now commonly used 
wherever school reform or renewal is attempted: stated and clear mission, instructional leadership, a 
school climate conducive for learning, high expectations for students and staff, student performance 
outcome measures, data-driven improvement planning. These phrases began with Effective Schools Re- 
search and are now the common language of school improvement today. Even disaggregation of data 
is now being legislated by some states in an effort to help districts to determine the distribution of 
subgroups of students' achievement scores, by socioeconomic status, race, ethnicity, and gender. The 
word disaggregation was used by eariy Effective Schools researchers to describe the process by which 
student outcomes, usually normed scores on standardized achievement tests, were broken into student 
subgroups and compared. 

Of course, many school improvement components were developed outside of Effective Schools 
Research: time-on-task considerations, active-learning time, and academic press were all names of con- 
cepts formed to identify pedagogical concerns in the classroom having to do with student achievement. 
The synthesis of research on teaching and learning behaviors proposed in the principles of Madeline 
Hunter, Cooperative Learning, Teacher Expectations and Student Achievement processes, and Mastery 
Learning are all examples of programs which promote teacher effectiveness. These concepts continue to 
be developed simultaneously as Effective Schools Research evolves. 

Effective schools and effective teaching arc complementary literatures in the field, and they inter- 
sect at classroom management concepts. Although the instructional program is the primary target of 
Effective Schools Research (ESR) efforts, interesting questions focus on school and district policies, 
programs, procedures, and practices and their relationship to student performance. Effective Schools 
Research attempts to create a framework for addressing organizational, instructional, and institutional 
issues which are encountered as practitioners address and implement school improvement based both on 
quality in educational program and equity for all students in program and process. 

Based upon the belief that **all children can learn," the Effective Schools model develops from a 
simple logic: If all students can learn, then we must structure school and district policies and procedures 
so that faculty arc supported in their daily work of teaching all children. Specifying the locus of respon- 
sibility for student learning with the faculty, the Effective Schools model centers around organizational 
feedback systems such as the student academic monitoring system and school accountability systems, 
which inform the classroom teacher and the school principal about how well each of them is doing with 
regard to specific criteria. 
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In this process, the unit of change is the school building organization. The faculty and principal in 
each building form a decision-making team that frequently includes parent and support staff representa- 
tives. Each team is designed in accord with the culture of the school and the characteristics of the 
neighborhood or community the school serves. 

Over time, school-based management (also called site-based management), a governing and plan- 
ning structure for school improvement, has developed alongside the Effective Schools model. In the late 
seventies and early eighties school-based management and the Effective Schools model were combined 
in the minds of some practitioners in their efforts to place responsibility for decision-making for day-to- 
(iay activities in the hands of the principal and staff at the school site. But without a comprehensive 
model like the Effective Schools model, school-based management is only a governance structure, not a 
program for comprehensive school improvement. Educators who were advocating each of these models 
held the other implicitly in their minds: School-based management people were reorganizing decision- 
making so that more responsive program decisions could be made on behalf of students and their par- 
ents. Effective Schools model researchers advocated a framework which embraced a set of correlates, or 
characteristics of Effective Schools, which, once in place, would interact to begin the renewal process, 
as long as the organizational resources were redirected, the monitoring systems were in place, and the 
school staff was committed to the new belief system that **all kids can learn.'' Those focusing on 
school-based management had the **shared decision-making at the school site" part of the model. 
Those looking at Effective Schools had the *'why'' of school improvement: to reach and teach all chil- 
dren. 



Design of the Present Group of Case Studies 

In the spring of 1988, the National Center for Effective Schools Research & Development sent a 
survey form to personnel in sixteen districts and one educational resource center v/ith whom the center 
personnel were working. This form was submitted to those districts which had worked faithfully and 
consistently over time to implement an evolving Effective Schools model. Some districts had been at 
work for over seven years (Jackson, Mississippi) while others had just begun. San Pasqual, a smaller 
district, was in the second year of implementation. Eleven of the districts and an educational resource 
center (the Middle Cities Association in Michigan) responded to the invitation to write their case stud- 
ies, using a common form (see Appendix A & B). Over the summer the districts wrote reports of what 
had transpired based on their own observations. 



Common Elements of the Comprehensive Model 

The editors held two priorities: (1) to keep the case studies in the langauge of the authors and (2) 
to report the studies in a comprehensive yet comparable way (hence the need for a form for each 
district's reporting). The paramount attribute to be emphasized was the comprehensiveness of the Effec- 
tive Schools model. 

The model's capability for adaptation within the culture and norms of each school and district will 
become evident to the critical reader. However the reader should pay particular attention to a number 
of elements which comprise the model. These elements or components of the model are embedded in 
several common themes which run through the case studies: 

• Schools and districts which early on attempted to apply Effective Schools Research realized 
that they ould do better, especially in reaching and teaching high-risk students in their in- 
structional procedures and educational programs. This primary motive for school improvement 
was instigated by the educational ''accountability" movement of the seventies. 
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• "Accountability*' is encouraged on different levels and is a highly valued motive for change. 

Pride and professionalism seem to promote the belief that school people can perform their roles to 
certain agreed-upon standards, and can be held accountable for that performance: 

• the schools are accountable to the community and parents; 

• ihc board of education to the citizens of the community; 

• the superintendent to the board and the community; 

• the principals to the superintendent and the community the school serves; 

• the teachers in a school to the principal; 

• the students to the teacher; 

• the support staff to the principal, teachers, and central office administrators. 

Accountability demands that goals be defined, that a district mission be stated as well as school 
missions, and that the work and policies in the district be consistent with the district mission. Evalu- 
ation processes proceed from these agreed-upon goals and evaluation measures decided upon by dis- 
trict consensus, as well as by federal, state, oi local law. 

By agreeing upon a mission, the people in a district pull together. The mission then acts like a rudder 
on a ship: it gives direction and stability to what otherwise would be a jagged course, depending 
upon prevailing winds and ocean currents. Accountability in this way promotes cohesion, a sense of 
*'what we are about/' and cuts down on counterproductive or diverse efforts. Accountability for an 
agreed-upon goal lessens political infighting among various outside and internal special interest 
groups. 

Finally, by stating district and school missions and opcrationalizing them with realistic goals and 
objectives, the organizations involved plan for **organized abandonment'' of counterproductive poli- 
cies and procedures. There will be more realistic annual plans written once ihey are opcrationalizcd, 
and each year prudence will dictate only two or three major goals be attempted. The stated mission 
should assure that these goals are consistent with one another as well as with the mission. 

• School improvement leaders recognized that small incremental chang s or pdjustments in 
teaching techniques are not the answer, in and of themselves. Changes in the classroom proce- 
dures and activities are necessary but not sufficient for beneficial and lasting change. Practitioners 
who started with pedagogical adjustments in classroom techniques soon learned that school and dis- 
trict policy and procedures often prevented implementation of new teaching innovations. Certainly 
those teachers **going it alone," unless they were experienced and exceptionally talentc i, were not 
able to sustain their efforts over time. This is especially the case with regard to the coordination and 
coverage of subject matter and teaching objectives from one level to the next. 

♦ Education leaders who saw a need for change were hesitant about how to start the Effective 
Schools Research improvement process. Team building, training in group dynamics, communica- 
tion skills, and skills of planning are necessary training areas for teachers and principals so they can 
conduct day-to-day decision-making at the school site. Most school teams and school faculties de- 
cided to develop these skills by working on a specific school project such as implementing a school- 
wide discipline code. Projects such as these provide a beginning and a foundation for school im- 
provement. 

* Those who plan improvements need appropriate, ongoing dialogue about staff development 
which links each school with central office staff or the superintendent's office. The importance of 
up-to-date training for principals, teachers, support staff, superintendents, and the board of education 
cannot be overemphasized. New ways of carrying out ESR are constantly being discovered. Barriers 
to school improvement, which usually center around the belief system and the reallocation of re- 
sources in target areas, are being addressed successfully across the country. 

1 2. 
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Finding time to meet, to plan, and to oversee the implementation of the Effective Schools pro- 
cess is one of the most difficult tasks practitioners undertake. Most of the added resources needed 
(and most districts feel that little new money is required once the staff development program is ade- 
quately funded) are needed in this area, in terms of released time. Also, certain official waiving" of 
parts of the teacher contract for a specified period of time, and according io the rules of the teacher's 
association, needs to be negotiated. 

Effective planned change requires a central system that monitors student progress and reports 
to teachers and principals in an accurate and timely fashion. Deciding what student outcomes to 
measure, and how to measure them for decision-making and planning purposes at the school site 
level, is not an easy task. The process of disaggregating data demands sophisticated interpretation, 
and the reporting of these data to internal and external constituencies is a sensitive issue. Such a 
system needs to document student scores and give fast and accurate feed-back to teachers for re- 
teaching. Because these structures h;ive been difficult to design, and because the amount and kind of 
testing best suited for teaching for learning for all varies across districts, regions, and even countries, 
student monitoring is often put or the back burner until other assessment questions (like teacher 
evaluation) are settled. The student monitoring system should be held separate from the teacher eval- 
uation system, as far as employment questions are concerned. The student monitoring system is part 
of the teacher conferencing system, and for the use of the principal and teacher to improve instruc- 
tion in the classroom. 

As early in the process as possible, teachers and other personnel need to align curriculum and 
develop criterion-referenced tests which measure mastery* For most teachers, knowing that their 
students will be tested on the topics and objectives that are being taught takes much of the uncer- 
tainty out of relying on standardized achievement test scores. Curricular alignment is also the first 
step in preparing criterion-referenced tests for the district, so that teachers using these tests can cover 
subjects adequately and know that all children are keeping up to date. 

^'Quality'' and **equity'* must be defined and their measures specified. Definitions clear up mis- 
understandings about goals and objectives. Effective Schools advocates are aware of the role public 
perception plays in assuring success, both within the school system and in the community it serves. 
Good public relations gives pride in accomplishment, to the people achieving, and to the community 
reaping the rewards of their endeavors. Early in the process, indicators of school improvement (see 
Appendix C, page 215) should be decided upon by the school board and the district planning team. 
These indicators should be used to make decisions internally. Certain indicators should be reported 
regulariy to the community. 

The ^'correlates'' of Effective Schools Research are a means to an end, and not an end in them- 
selves* One of the best indicators of a good understanding of Effective Schools Research is when a 
practitioner or researcher realizes that the correlates are characteristics of effective schools, not the 
goals of the Effective Schools process. The goal is to design district and school policies and proce- 
dures so that they support the classroom teacher in his or her effort to teach for the learning of all 
students. 

Leadership on the part of the superintendent, principals, teachers, and outside consultants is an 
essential part of the process of school reform and renewaL Because the process of change does 
not take place overnight, or even in a year or two, practitioners must have the determination to see 
things through when they get bogged down. The model is specific enough to point to the areas of 
concern; the people responsible for implementation must make their owr. decisions and be innovative 
in finding solutions to the problems they encounter. Commitment, enterprise, and persistence are es- 
pecially crucial in large school districts, where organizational momentum can be slowed easily, in 
some cases without warning, when internal or external political questions remain unresolved. Inter- 
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nally there is always the possibility that the school improvement process will become the target of 
unrest within the ranks of teachers, principals, or support staff associations. Usually, the key question 
to be resolved centers on the traditional bargaining arenas of working conditions, salary, and fringe 
benefits and not the school improvement program. It is important to separate the issues early on in 
negotiations and keep the improvement process moving. 

The case studies should be read, then, with a focus on pragmatism. The threads running through 
these reports are dynamic, often a product of mutual causations in the district. (A good example of 
mutual causations is the development of **high expectations.'' This belief on the part of teachers in part 
proceeds from experiencing higher student achievement and in part fosters higher student achievement.) 
Phenomena which result from mutual causation are hard to research. So is a non-linear process of de- 
velopment, which the Effective Schools Research process of school improvement most certainly is: iter- 
ative at every step. Involving many complex, interlocking decisions, and many actions on the part of 
various persons, the model makes sequential analysis difficult, and predictive and explanatory analysis 
almost impossible. 

To understand better what seems to be confusion, a new philosophical underpinning is needed. In 
his b..ok. After Virtue, Alisdair Mclntyre describes the essence of a good leader in reorganizing for a 
specific goal: 

Qcarly his first step would have to be the creation of an organization to provide an instrument for his project and 
equally clearly his first task would have to be to render the activity of his own organization wholly or largely unpredict- 
able. For if he were unable to achieve this, he could scarcely achieve his larger goal. But he would also have to render 
his organization efficient and effective, capable of dealing with its highly original task and of surviving in the very 
environment which it is committed to changing. Unfortunately these fn'o characteristics, total or near total predictabil- 
ity on the one hand and organizational effectiveness on the other, turn out on the basis of the best empirical studies we 
have to be incompatible (italics added). Defining the conditions of effectiveness in an environment that requires innova- 
tive adaptation Tom Bums has listed such characteristics as ^continual redefinition of individual task,' ^communication 
which consists of information and advice rather than instructions and decisions,' ^knowledge may be located anywhere 
in the network' and so on (Bums 1963, and Bums and Stalker 1968). One can safely generalize what Burns and Stalker 
say about the need to allow for indixndual initiative, a flexible response to changes in knowledge, the multiplication of 
centers of problem-solving and decision-making as adding up to the thesis that an effective organization has to be able 
to tolerate a high degree of unpredictability within i/se// (italics added). Other studi: confirm this. Attempts to monitor 
what every subordinate is doing all the time tend to be counterproductive; attempts to make the activity of others 
predictable necessarily routinize, suppress intelligence and flexibility and tum the energies of subordinates to frustrating 
the projects of at least some of their superiors (iSaufman 1973, and see also Burns and Stalker on the effects of attempts 
to subvert and circumvent managerial hierarchies). 

Since organizational success and organizational predictability exclude one another, the project of creating a 
wholly or largely predictable organization committed to creating a wholly or largely predictable society is doomed and 
doomed by the facts about social life (pp. 105-106). 

The Effective Schools Research model is a process, a framework for decision-making by educators 
who would make their schools places of learning for all students. These case studies illustrate common 
practices, describe the more pervasive program barriers and opportunities encountered, and show that 
increased staff and student morale can come from shared decision-making in a collaborative enterprise 
that owns regular success. 

This mode! is descriptive, not predictive, except for a list of the general types of work to be done 
by the people involved. The outcomes of that work are politically and socially different for each district 
and each school. The outcomes are related to an increase in higher academic achievement for all stu- 
dents. Further systematic research is needed to substantiate these findings. 

However, the lessons we have learned from this pragmatic knowledge-base are important and use- 
ful. Dr. Lezotte's summary chapter weaves the threads together in a descriptive and explanatory text 



*Scc Lincoln and Guba (1985), Natura!i<:tic Inquiry (Beverly Kills: Sage Publications), pp. 150-157. The authors' discussion of "mutual simul- 
taneous shaping'* is worthy of study by practitioners and researchers alike. 
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which adds to our understanding of the Effective Schools model and its application in a variety of 
districts. 

The National Center for Effective Schools Research and Development thanks all the authors of the 
case studies, their boards of education and superintendents for allowing the case studies to be written 
and published. The degree of forthrightness demonstrated by their candid contributions io the field of 
education reflects the openness of the districts involved and their commitment to the Effective Schools 
process for school improvement. 

Barbara O. Taylor, Ph.D. 
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The Language of Practice 

The language of educational practitioners is distinctly different from the language of educational 
researchers. The language of researchers is typically third person, present or past tense with passive 
verbs, and in its attempt to be accurate often seems quite stilted to the untutored mind. The language of 
practitioners is typically first or third person, with active verbs in the present, past, or past progressive 
tense — or all three within the same paragraph — and changes easily to tell a moving story. 

In their effort to represent interesting day-to-day experiences practitioners design sentences which 
pull together many threads or elements of which they are aware, knowing that this whole cloth is the 
way things happen in school. The researcher's job is to take these tapestries and sort out the patterns, 
the paths, the relationships, and the symmetry of development. Indeed, most practitioners would argue 
that it is impossible to separate content and process elements in daily deliberations at the school house; 
only the researcher can do that on paper and at a distance, looking back on what happened and trying to 
see what is process, what is content. 

The language of practice in this way often appears too personal, too anecdotal, even disorganized 
in its presentation. And yet practitioners' reflection upon their actions, decisions, and roles played is an 
authentic genre of applied research. What practitioners link together and the emphasis they give each 
action mentioned tells the researcher a great deal. Indeed research on language should be developed and 
its protocols made more systematic. Building on the strengths of direct experience and the immediacies 
of special situations, of constant synthesis in interpreting organizational dynamics, which include a bias 
for what really matters, the spoken word of practitioners is invaluable data (Mintzberg et al., 1976). 
The practitioner's written work is just as helpful, and is easier to analyze because it is permanent and 
decidedly thoughtful. 

Each language is instructive to the other. While the language of practice generally describes, and 
that of research analyzes, each language does both; it is a question of emphasis. The practitioner is a 
constant interpreter of what is going on, and **makes sense'' of the actions and discussion and behav- 
iors of the school as they take place. Analysis for the practitioner is almost coexistent with description. 
The **why" of practice is generally up front: Give reason to the student, give reason to the teacher, 
give reason to the administration, as the conversation happens. 

The researcher, on the other hand, is told to keep distance from whatever is being studied in order 
to analyze after the fact what indeed did occur. And then the researcher must interpret and answer why 
it occurred. The **why" of research comes after lengthy methodologies, as mature evidence manifests 
itself within an accepted paradigm. 

Both languages are important sources of social data, but the data of practitioners are more difficult 
to recognize. In these case studies the hard data are only suggested by the narratives, and are interpre- 
ted within the rich context of daily work and professional judgment. Disaggregated test scores and other 
indicators are compared over time, and then each school's educational program and procedures are 
called into question where student outcomes are not improving. Precise delineation (the researcher's 
hallmark) gives way to breath of description in the practitioner's language, and the phenomena being 
discussed are rendered extremely complex. 

Mintzberg, H.; Raisinghani, D.; Thcorct, Andre. **Thc Structure of 'Unstructured' Decision Processes." Administraivc Science Qtuzrtcrly 21 
(June 1976):246-75. 
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The language of practitioners is not easy for the novice to understand, and the analytic process 
needed to understand it is only now being developed. The first requirement for doing naturalistic re- 
search is to understand the context of the situation. The researcher then has two fundamental jobs to 
perform: to delineate the contextual milieu, and then to report clearly the specific elements or compo- 
nents of interest. This makes an investigation very risky and time-consuming. 

The National Center for Effective Schools hopes that these case studies will intrigue educational 
researchers and compel them to test a few of the hypotheses they find within them. We hope the educa- 
tors in the field will read these case studies, find enough evidence of what works to build confidence, 
and then get about the business of improving schools for all children, using action research and trial 
and error strategies. 

There are many conversations to be held between researchers and practitioners, and they proceed 
from both parties. The language of both actors has instruction for each, if only each will listen carefully 
and reflect on what is being said. There are many roles to be played in school improvement, and all of 
them are important. 

Barbara O. Taylor, Ph.D. 
Madison, Wisconsin 
October 1989 



IS 



ERIC 



Reaching for 
Equity in Prince 

Public 



Excellence and 
George's County 
Schools 



John A. Murphy 

Superintendent of Scttools 

Louise F. Woynont 

Associate Superintendent for Instruction 



14 



Case Studies in Effective Schools Research 



Prince George's County, Maryland 

Became involved in Effective Schools process in 1985 



Community 

Populcrtlon 

710.014 (Prince George's 
County) 

7yp# 

Located in the Washington, 
D,C.-BaItimore corridor. 
Economic base — Workforce 
comprised of federal 
employees.military personnel, 
and employees of high-tech 
businesses. Per capita 
income is $18,477. County 
has a 50 percent minority 
population and therefore 
reflects a high degree of 
diversity. 

Socioeconomic Description 

Predominantly middle class, 
urban/suburban geographic 
mix, 50 percent minority 
population. 1 6,230 students 
qualify for free lunch; 7.083 
students qualify for reduced 
lunch. 



School District 



Enrollment 

104,140 

Ethnic Composition, (percent) 

African-American 63.2 

American Indian .3 

Asian-American 3.9 

Caucasian 29.7 

Hispanic 2.5 

Per Pupil Expenditure 

Year 1988-1989 $4,353 

Year 1989-1990 4.710 



Percent bussed 

72.6 



Area (in square miles) 

489 

Schools 

Elementary schools 114 (K-6) 
Middle schools 26 (7-8) 
High schools 20 
Other 10 

(special education) 

Number of Staff 

Administrators 1 50.5 

Ceitified Teachers 6,728.8 
Support staff 4,714.8 
(including 102.5 
administrative support) 

Student-Teacher Ratio 

Average class size: 

Kindergarten 21 .3 

Grades 1h3 26.3 

Middle 24.3 

High school 25.1 

Percent college-bound 
(approx.) 

61 



Abstract 



Prince George's County Public Schools 
played an important role in the deveiopmeni Oi 
the Effective Schools Research model: This was 
the first time a diverse district decided at the 
beginning of the process that every school in 
the district, a large, county-wide system, would 
embark on a school improvement program 
based on Effective Schools Research (ESR). In 
previous years (1978-84) ESR consultants had 
often helped districts design student academic 
monitoring and personnel assessment systems 
when they found they needed them. However, 
in Prince George's County, these systems were 
designed and Installed (using disaggregated 
analysis procedures) early in the improvement 
program, along with the training components 
for the school improvement teams. In addition, 
training in team building for school personnel 
was carried out in the first two years of planning 
and Implementing and is an ongoing part of 
staff development. 



The results of Prince George's County efforts 
have been reported coast-to-coast. Especially 
interesting for the reader are detailed descrip- 
tions of the impact of the Effective Schools pro- 
cess upon the student monitoring system, in- 
cluding how student achievement is measured 
and analyzed, the impact of ESR implementa- 
tion on curricular and staff development sys- 
tems, and the impact of the process on person- 
nel evaluation. 

The communities served by this county sys- 
tem also profited from the ESR comprehensive 
plan for school improvement. Most importantly 
the model had positive effects on desegrega- 
tion efforts and on achievement for **at-risk" 
students. 
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Overview 

In January 1988, the eyes of the nation were on 
the Prince George's County Public Schools as the 
President of the United States visited the school sys- 
tem to recognize progress the system had made in im- 
proving student achievement and establishing magnet 
schools to address desegregation issues. Following his 
visit, President Reagan wrote to Superintendent John 
A. Murphy, **Great things are happening indeed in 
the Prince George's County Public Schools. Please 
tell the students, the teachers, and the administrators 
to keep up the outstanding work." 

During the months following the President's visit, 
educators throughout the country called or visited to 
learn more about the exciting and innovative pro- 
grams underway in the school system. The question 
visitors asked most frequently was this: What has 
made such a dramatic difference in the school sys- 
tem? A significant part of the response to this ques- 
tion is the impact made by implementation of the Ef- 
fective Schools process. 

Prince George's County Public Schools, located 
between Washington, D.C., and Baltimore, Maryland, 
is the 16th largest school system in the nation: a het- 
erogeneous, urban-suburban school district in which 
over 104,100 students are enrolled. The 172 schools 
in the district include 114 elementary schools, 26 
middle schools, 20 high schools, 2 vocational schools, 
and 10 special education centers. Often called a 
"school system of choices,'' the Prince George's 
County Public School system offers magnet programs 
in 44 schools. The racial composition of the school 
system is approximately 64 percent black, 30 percent 
white, 4 percent Asian, 2.5 percent Hispanic, and .3 
percent American Indian. The school system employs 
over 6,700 teaches, 29 percent of whom are black, 
and 71 percent other. 

The early years of the 1980s marked a very diffi- 
cult time for Prince George's County Public Schools. 
A devastating tax referendum led to budget reductions 
that cost the school system 500 teaching positions. As 
a res;*,lt of lost revenues. Prince George's class sizes 
were among the highest in the state and teachers' sal- 
aries had dipped to the bottom of systems in the 
Washington, D.C. metropolitan area. Exacerbating the 
plight of the school system were unresolved desegre- 
gation issues which created tensions throughout the 
community. Although student achievement had been 
increasing gradually, the average achievement scores 
for the school system still were below state and na- 
tional averages. Of even greater concern to school 
system educators and the community was an unac- 
ceplably large gap between the performance of black 



and white students on state-mandated standardized 
and functional achievement tests. 

The story of Prince George's journey from the 
troubled days of the early 1980s to its current posi- 
tion as a pacesetter for minority student achievement 
and innovations in the instructional program began 
with a simple, but dramatically important, step: iden- 
tifying the major problem of student achievement and 
taking ownership of that problem. At the heart of the 
problem was low expectations for students' achieve- 
ment and, in particular, for the achievement of minor- 
ity students. In the difficult fiscal and political cli- 
mate that pervaded the school system, its educators 
had begun to question their power to make a differ- 
ence and had limited their expectations for students' 
achievement. 

John A. Murphy, newly hired superintendent of 
schools for Prince George's County Public Schools, 
provided the vision that led to dramatic improvements 
in the school system, and, most significantly, dramatic 
improvements in minority student achievement. 
Among the actions the superintendent initiated to ad- 
dress student achievement was implementation of the 
Effective Schools process. With its dual focus on 
quality and equity, the Effective Schools process was 
a means to improve achievement for all students, 
while closing the gap between performance of black 
and white students. 



Implementing the Effective 
Schools Process 

Year I: Preparing for Effective Schools 
Process Implementation 

In preparation for initiating the Effective Schools 
process, the superintendent sent a team of school sys- 
tem educators to an Effective Schools Leadership 
Training Institute in Phoenix, Arizona, in January 
1985. Later in the year, he met personally with Law- 
rence Lezotte, then chairman, Etepartment of Educa- 
tional Administration, Michigan State University, to 
outline a broad strategy for school system implemen- 
tation of the process. Board of education members 
met with Dr. Lezotte during a breakfast meeting at 
the National Federation of Urban-Suburban School 
Districts Conference in Jackson, Mississippi, in May 
1985, to discuss implications of implementing the 
process in Prince George's County Public Schools. 
Additionally, the six area assistant superintendents 
and the directors in the division of instruction partici- 
pated in the Summer 1985 Effective Schools Institute 
held in Williamsburg, Virginia. 



mmnmim 2i 
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Principals* Leadership Training 

The Effective Schools process was "officially** 
launched in July 1985 when Dr. Lezotte met with all 
school system principals during their three-day Sum- 
mer Leadership Training Institute to describe the re- 
search on which the Effective Schools correlates were 
based and to outline the steps schools need to follow 
in implementing a school improvement effort. Dr. 
Lezotte served as consultant to the school system 
throughout the planning and implementation process 
and led a series of leadership seminars for principals 
which explored in depth the topics introduced during 
the Summer Leadership Training Institute. 

The leadership seminars emphasized the steps to 
follow in conducting a needs analysis which would 
guide development of local school improvement 
plans. The needs analysis to be conducted in each 
school would consist of three parts: analysis of disag- 
gregated student achievement data, assessment of the 
strength and presence of Effective Schools correlates, 
and use of archival information such as suspension 
and attendance data. At several seminar sessions the 
principals developed or adapted a survey instrument 
for their school staffs to use in assessing the degree to 
which effective schools correlates were in evidence in 
the schools. Instruments were developed for elemen- 
tary, middle, and high school as well as for special 
education centers, 

A first-year seminar of particular interest to princi- 
pals described how to select and work with school 
improvement teams. Guidance was provided concern- 
ing ways to create a representative team and to initi- 
ate the process of shared decision making at the local 
school level. The seminar provided a forum to discuss 
how teachers could become involved in the process of 
needs analysis, goal setting, and evaluation. 

Preparing for Local School Implementation 

The opening of the 1986-87 school year was des- 
ignated as the time to **launch'* local school im- 
provement activities. In preparation for implementing 
the Effective Schools process in their schools, each 
principal developed a plan which described how the 
Effective Schools process would be introduced to his 
or her staff, and how the School Improvement Team 
would be formed. To assist principals with implemen- 
tation of school-based staff orientation activities, an 
Effective Schools reference notebook was provided 
for each school, along with a videotaped interview 
vs'ith the superintendent, the associate superintendent 
for instruction, and Dr. Lezotte. 



Year II: Implementing the Effective Schools 
Process at the School Building Level 

Effective Schools implementation activities during 
the 1986-87 school year were focused at the local 
school level. Each school completed four implementa- 
tion activities by 

• providing an orientation to the Effective Schools 
process for the total school staff 

• selecting a school improvement team 

• conducting a needs analysis which featured (1) use 
of the Effective Schools surveys, (2) analysis of 
disaggregated student achievement data, and (3) re- 
view of all other data which could inform the 
needs analysis process 

• developing a school improvement plan based on 
the needs analysis. 

Schools organized their first school improvement 
plans around the Effective Schools correlates which 
seemed most relevant to their needs. Implementation 
strategies and activities were selected, and resources 
and technical assistance needed to implement the 
plans were identified. Completed plans were sent to 
the superintendent of schools and area assistant super- 
intendents for review. 

Providing coordination for implementation of the 
Effective Schools process during this second year of 
implementation was a newly appointed Director of 
Effective Schools and Principals' Leadership Train- 
ing. The director selected a principals* advisory com- 
mittee to provide dialogue for leadership training ac- 
tivities which would continue to support Effective 
Schools process implementation. A major focus of the 
leadership seminars during the second year was how 
to use disaggregated data to analyze and monitor stu- 
dent achievement at the local school level. 

Year III: Refining the Implementation 
Process at the School Building Level 

When school improvement plans for the 1987-88 
school year were reviewed, it became apparent that 
additional guidance from central office in three areas 
would help schools refine their plans by 

• aligning strategies with objectives to assure that 
strategies selected were likely to lead to the out- 
comes identified by the school 

• identifying formative and summative evaluation 
strategies to help schools assess whether goals and 
objectives had been reached 

• selecting objectives which were significant,non- 
trivial, in nature and addressed the correlates, or 
goals, selected for implementation. 
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AN INDEPENDENT NEWSPAPER 

Promises Kept in Prince George 's 



THREE YEARS ago. Prince George's Coun- 
ty School Superintendent Jo!in A. Murphy 
promised that his stud^^^ts* would reach the 
75th percentile on standardized tests by 1990. 
When pupils reach that level, they have scored 
higher than 75 percent of the students tested 
nationally. That's an important threshold, within 
reach of highly regarded schools such as those in 
Montgomery County, where students have hit the 
80th percentile. Black students in Prince 
George's, as a group, had test scores far below 
those of whites. The superintendent promised to 
close that gap. Few believed that both things 
could be done at the same time. They were 
wrong. 

T'he California Achievement Test (CAT) meas- 
ures the readmg. math, spellmg and language 
skills of third-, fifth- and eighth-grade students. 
Recently released scores show that Prince 
George's third-grade students hit the 73rd per- 
centile on the total battery of tests, the highest 
score ever for Prmce George's and an increase of 
nine points since 1986. Both fifth- and eighth- 
grade students improved by nine points, up to the 
69th and 67th percentiles respectively. 

© The Washington Post 



Some black students in Prince George's had 
already recorded high scores, but more and more 
have excelled on the CAT. In 1987 black students 
ranked above the 50th percentile for the first 
time. This year, third- and fifth-grade black stu- 
dents surpassed the 60th percentile, and the gap 
in test scores is also shrinking. Black third-grade 
students, for example, trailed whites by 25 points 
in 1984, but by only 17 points this past year. 

Higher budgets, more teachers and a back-to- 
basics curriculum have helped produce the overall 
improvement. Schools such as Dodge Park Ele- 
mentary have shown that black students (96.4 
percent of enrollment) can score as high as any 
others. 

At Dodge Park, teachers expect more from their 
students. More homework is assigned, and regular 
exams test skills needed for the CAT. A computer 
lab has helped math students, and parents are given 
booklets to test their children over the summer. In 
1986 Dodge Park's third graders scored at the 77tn 
percentile. They reached the 94th percentile on the 
last CAT. That type of performance has helped lift 
the Prince George's schools to the threshold of 
excellence. 



This revision process caused some concerns. Al- 
though initially an issue of much concern to teachers 
and principals, the revision process initiated by the 
central office ultimately improved the likelihood that 
schools would reach the goals they had established. 

The Department of Staff Development analyzed 
school improvement plans and computerized a **mini- 
profile'' of each schoors plan to assist with providing 
requested resources and support. The mini-profiles in- 
cluded the correlates each school had selected for im- 
plementation and summarized requests schools had 
made for resources and staff development assistance. 
The three correlates most frequently included in the 
school improvement plans were (1) positive home- 
school relationships, (2) high expectations for success 
for all students, and (3) safe and orderly school envi- 
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ronment. Staff development topics most requested 
were establishing high expectations for student 
achievement, approaches to classroom management, 
and communicating with parents. 

Throughout the third year of Effective Schools pro- 
cess implementation, principals continued their partic- 
ipation in monthly leadership seminars. The central 
theme of this group of seminars was establishing ex- 
cellence and equity. 

At the end of the school year, each school im- 
provement team gathered and analyzed results from 
the current year's school improvement activities to 
determine which objectives were reached and what 
next steps were needed. If objectives were not 
reached, reasons were discussed and a decision was 

23 - 
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made whether the objective should be refined or even 
included in the plan for the following year. 

Year IV: Extending the Implementation 
Process at the Local School Level 

As a result of experiences gained during the initial 
years of Effective Schools process implementation, 
several changes were made in the guidance provided 
for the development of school improvement plans. 

♦ Rather than developing a one-year plan, schools 
were as'.od to develop long-range plans. 

♦ Rather than selecting Effective Schools correlates 
as the basis for developing school improvement 
plans, schools were asked to identify two to four 
long-range goals which reflected the results of 
their needs analysis, and then to select specific ob- 
jectives which addressed the long-range goals. 

♦ Rather than have the plan signed only by the prin- 
cipal, all members of the school improvement team 
were asked to sign the plan before sending it to 
iheir area assistant superintendent for review. 

♦ Rather than limiting schools to ^'traditional** solu- 
tions to identified problems, schools were encour- 
aged to try innovative strategies to address their 
objectives. 

Taken together, these revised guidelines invite 
schools to try strategic, long-range planning to pro- 
mote and assure a higher degree of teacher involve- 
ment. They encourage school staffs to think beyond 
traditional solutions to shape school improvement. 



Placing the Effective Schools Process 
in the Context of an Effective 
School System 

When Prince George*s County Public Schools initi- 
ated the Effective Schools process in 1985, emphasis 
was placed almost exclusively on the process as it re- 
lated to each local school and the roles and responsi- 
bilities local school personnel should assume in im- 
plementing the process. As individual schools 
"launched** their Effective Schools activities, numer- 
ous requests for resources and technical assistance 
were made to central and area offices. The requests 
for support of local building school improvement ac- 
tivities, the need for coordination of response to these 
requests, and the compelling message of the Effective 
Schools Research for broader school system decision 
making clearly identified the need to involve every 
component of the school system in the Effective 
Schools process. Simply stated, effective schools 



needed to exist within the supportive context of an ef- 
fective school system. 

Although much research was available to inform 
local building implementation of the Effective 
Schools process, little was known about organizing an 
entire system to support this effort. Nor was it clear 
from existing research and experience what the char- 
acteristics of an effective school system should be. 

Defining the School System Mission and 
Goals in "Effective Schools" Terminology 

The first step toward becoming an effective school 
system was defining a new mission statement and 
new school system improvement goals as a spring- 
board from which local schools could develop their 
statements of mission and goals. The new mission 
statement clearly reflected the dual focus of quality 
and equity: the belief that all children can learn, and 
that teachers are able to reach and teach all children. 



Mission Statement of Prince 
George's County Public Schools 

The mission of the Prince George's County 
Public Schools is to assure that all students 
acquire knowledge and develop the skills 
and work habits to enable them to become 
productive members of society. This mis- 
sion is best accomplished in an environ- 
ment bharactertzed by ^ strong instructional 
leadership, high expectations for success 
for alt students, sufficient time for teaching 
and learning, a safe and orderly scboof en- 
vironment, frequent monitoring df students' 
progress, and effective home-school com- 
munication. 



Next, school system improvement goals were de- 
veloped and announced to the community and the 
press, putting system educators "on the line'' for im- 
proved student achievement. These goals state clearly 
what expectations for student achievement will be: 

• Standardized test scores for Prince George's 
County Public Schools will show annual increases 
in the percentages of students within the upper 
quartile and annual decreases in the percentage of 
students in the lower quartiles. 

♦ Functional test scores for Prince George's County 
Public Schools will show annual increases in the 
percentage of students at grades nine and ten who 
reach or exceed the criterion for mastery. 
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• The gap betv/een achievement scores for black and 
non-black students will diminish annually, while 
achievement scores for all students will increase. 

• Criterion-referenced test scores will show annual 
increases in the percentage of students at each 
grade level who attain essential objectives. 

These school system improvement goals became 
the foundation for the school system's strategic ac- 
tion plan which details both short term and long term 
action needed to reach the goals, indicates the indi- 
viduals responsible for this action, and describes the 
specific evaluation strategies to be followed to deter- 
mine if the action has been successful. 

Defining an Effective School System 

After considerable discussion and examination of 
the literature. Prince George's County Public Schools' 
personnel created their own definition of an effective 
school system. Characteristics of an effective school 
system were identified and implications for planning 
and action suggested by these characteristics were de- 
veloped. (See Appendix A in this case study) Addi- 
tionally, each central office division and area office 
within the system defined its roles and responsibilities 
in supporting implementation of the Effective Schools 
process. 

Prince George's County Public Schools defined an 
effective school system as **. . . one in which all re- 
sources are organized and delivered in such a way as 
to assure that all students within that system ... re- 
gardless of race, gender, or socio-economic status . . . 
learn the essential curriculum as defined by that sys- 
tem. An effective school system, through its statement 
of mission and goals, its instructional program and 
support services, and its allocation of resources, as- 
sures that its priorities are teaching and learning, and 
that its focus is on both quality and equity." 

Ten characteristics of an effective school system 
were identified as: 

1. strong, instructionally focused leadership 

2. clear and focused mission 

3. frequent monitoring of student progress 

4. climate of high expectations for success for all 
students and staff 

5. purposeful and supportive involvement of par- 
ents, other citizens, and business and commu- 
nity groups 

6. curriculum and instructional programs that as- 
sure opportunities for every student to learn 



7. support for schools to assure a safe and orderly 
learning environment for students 

8. high rate of attendance for students and all 
school and non-school based staff 

9. strong staff development program which reflects 
and supports the implementation of the Effec- 
tive Schools process 

10. clear understanding on the part of all staff as to 
their specific roles and responsibilities in con- 
tributing to the Effective Schools process, and 
an evaluation process which supports this under- 
standing. 

This school system commitment to and involve- 
ment with the Effective Schools process have signifi- 
cantly influenced **mandating and prescribing*' to 
** helping and supporting." A second difference has 
been the increased emphasis on school-based decision 
making and innovation. 

As a symbolic way to illustrate this change in 
focus, the 1986-87 school year was launched with a 
summer leadership training workshop during which 
principals were given red buttons which stated 
**Priority" and central and area office personnel wore 
green buttons which asked, **How Can I Help?" Ad- 
ditional examples of the impact the message of the 
Effective Schools Research has had on the school 
system are described in other sections. 

Creating an Effective Schools 
Steering Committee 

Just as each school needs a school improvement 
team to guide its implementation process, so a school 
system needs a system-wide steering cor..nittee to 
provide input to the superintendent to help monitor 
and adjust" the system-wide implementation process. 
The Prince George's County Public Schools Effective 
Schools Steering Committee, formed at the end of the 
third year of implementation, had three primary re- 
sponsibilities: 

• overseeing the implementation process, and making 
recommendations for change, as needed 

• designing and updating a comprehensive, long- 
range plan for staff development, and communica- 
tion about Effective Schools process implementa- 
tion 

• advising on the collection, analysis, and use of 
data in instructional decision making. 

Members of the steering committee include princi- 
pals, teachers, parents, and representatives from each 
central office division and each area office. 
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Impact of the Effective Schools Process 
on How Student Achievement Data Are 
Gathered, Interpreted, and Used 

The Effective Schools process has had a major im- 
pact on how student achievement is measured in 
Prince George's County Public Schools, and how 
achievement data are interpreted and used. The most 
significant change in how student achievement is 
measured has been the development and use of crite- 
rion-referenced tests which are based upon the objec- 
tives which form the curriculum for Prince George's 
County Public Schools. These tests are developed by 
teacher teams who work with curriculum supervisors. 
Currently, the tests at the elementary level are admin- 
istered in September, January, and June. At the sec- 
ondary level, tests are administered at the beginning 
and end of courses. Eventually, items will be avail- 
able in computerized banks which will enable teach- 
ers to access the items immediately after a unit of 
work has been completed. 

A second change the Effective Schools process has 
made in how student achievement is measured has 
been the use of multiple sources of data to create a 
more comprehensive "picture*' of student achieve- 
ment. Data from grade distributions, criterion-refer- 
enced tests, placement in instructional groupings, 
standardized and functional tests, enrollment in and 
level of success with higher level courses, and schol- 
arship awards are among the types of data now used 
to assess student performance. 

Analyzing Student Achievement 
Data: Disaggregation of Data 

The primary impact made by the Effective Schools 
process on how student achievement data are ana- 
lyzed has been the disaggregation of data by race and 
sex. Procedures soon will be available to analyze 
achievement data in terms of socioeconomic factors 
as well. Disaggregation of data from criterion-refer- 
enced tests, standardized and functional tests, grade 
distributions, course assignments, and attendance en- 
able educators to determine if student progress is 
shared across all groups of students within the school 
or school system. 

Using Data for Instructional Decision-Making 

As a result of implementation of the Effective 
Schools process, decisions made about the instruc- 
tional program at the school and school system level 
are decisions now based upon extensive data analysis. 
The school system h-is become a "data-driven'* orga- 
nization at every level. Student achievement data 



form the heart of the needs analysis process at each 
local school, in each area office, and at the sch(X)l 
system level. 

Summary 

In summary, the Effective Schools process has sig- 
nificantly influenced procedures used by the school 
system to assess, interpret, and monitor student 
achievement. A strong emphasis is placed on fre- 
quent moDitoiing of student performance, adjusting 
instruction based upon analysis of achievement data, 
and accountability for student outcomes. Because we 
know that "what gets measured gets taught,'' our 
measures of student achievement reflect the signlfl* 
cant objectives and skills upon which our curriculum 
is based. Because we know that **who gets measured 
gets noticed,'* our assessment is Inclusive in nature. 
Special needs students are included in the assessment 
and accountability measures used by the school sys- 
tem. 

In the superintendent's conference room — called 
by many the "applied anxiety room" — are graphs 
charting the trends in student achievement for every 
school. Effective Schools Research illustrates that the 
achievement gains made by many schools can be 
made by all schools. The graphs are an ever-present 
reminder of this goal. 



Impact of the Effective Schools Process 
on Curriculum and Instruction 

The body of research which informs Effective 
Schools process implementation has strong implica- 
tions for curriculum and instruction. The message of 
Effective Schools states clearly that all students can 
learn; therefore, all students must have access to qual- 
ity instruction in both essential basis skills and higher 
level thinking skills. All students must **sec 
themselves" in the curriculum — thus, their education 
must be multi-cultural in nature. Teaching for learn- 
ing implies use of a broad range of instructional strat- 
egies, attention to students' learning styles, and incor- 
poration of instructional technology in the learning 
process. 

Higher Level Thinking Skills for All Students 

For too long instruction in higher level thinking 
skills has been limited to highly able or lalenied and 
gifted students. Yet we know from Effective Schools 
Research thai high expectations for achievement must 
be maintained for all students. Higher level thinking 
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skills must be taught to all students if we truly be- 
lieve in quality and equity. Curriculum revision, staff 
envelopment, enrollment in higher level courses, and 
use of more challenging texts are among the actions 
currently underv/ay in Prince Gcorge^s County Public 
Schools to upgrade the teaching of higher level think- 
ing skills. 

A specific example of the school system's commit- 
ment to higher expectations for all students is the sys- 
tem-wide goal that by 1990, pre-Algebra and Algebra 
I will become courses in which at least 80 percent of 
the students in Prince George *s County Public 
Schools will enroll. Approximately half of Prince 
George*s students currently enroll in these courses. 

Multicultural Education: 

A Feature of Effective Schools 

The Prince George's County Public School System 
has a remarkably heterogenous student population and 
is often called a **patchwork quilt*' with respect to its 
diversity. Effective Schools Research clearly illus- 
trates that all students can learn, yet unless students 
can identify with the curriculum and participate in 
classrooms where teachers are sensitive to their needs, 
ihcy may not perceive themselves as individuals with 
the potential to succeed in school and society. Ma- v 
"at-risk" students have little sense of belonging anu 
identification. Additionally, future graduates will live 
in an international society and must know the skills of 
collaboration and communication with individuals dif- 
ferent from themselves. 

In May, 1987, the board of education passed a res- 
olution in support of multicultural education. In addi- 
tion, a school system-community task force has 
worked for a full year to identify curricular changes, 
staff training needs, and instructional materials which 
will support an emphasis on multicultural education. 

Instructional Use of Computers 

The Prince C-eorge's County Public Schools' focus 
on success for ail students has significantly influ- 
enced the system's approach to the instructional use 
of computers. Use of computers is not seen as a 
reward" for interested and/or able students, but as 
an important learning tool or resource for all students. 

In 1984 fewer than 950 microcomputers were 
available in the 171 schools within the system. Cur- 
rently, that figure has expanded to more than 6,500. 
Used with high quality software, computers can bring 
about measurable gains in student achievement. 
Prince George's County Public Schools is on the 
"cutting edge" of using computers for instructional 
purposes. IBM (International Business Machines) and 
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ESC (Education Systems Corporation) have joined 
forces and resources to offer a highly innovative com- 
puter installation. Students will have computers in 
their classrooms with **state of the art" software and 
an easy-to-use management system. 

Teaching for Learning 

Teaching for learning calls for a focus on both the 
process of leaching and the outcomes to be reached. 
Because effective teaching is teaching that leads to 
desired student outcomes, it is important to ass: re 
that the outcomes selected are significant, and the 
teaching strategies and materials used are ones which 
will help reach the identified outcomes. To support 
teachers in their teaching effectiveness, several initia- 
tives have been taken. 

• Standards for Excellence for Teaching have been 
defined, and all new and tenured teachers are given 
staff development options to grow in these 
standards' areas. 

• Research-based teaching strategies such as Cooper- 
ative Learning have been emphasized and school 
system educators work with personnel from col- 
leges and universities in the area to identify and 
apply these strategies. 

• Elements of effective lessons have been defined 
and are featured in staff development activities. 

• To create more time for learning, new ways to or 
ganize classroom time and provide more direct 
teacher-student contact have been initiated. Use of 
parallel block scheduling, re-grouping students for 
specific instructional tasks, and using a two-group 
instructional model are examples of ways to in- 
crease instructional time. 



Impact of tlie Effective Schools 
Process on Staff Development 

Creating Strong Instructional Leadership 

Instructional leadership is a correlate of the Effec- 
tive Schools process which has been strongly empha- 
sized in Prince George's County Public Schools. Evi- 
dence from past and recent research continues to 
confirm that the school reflects its leader. If the 
leader focuses on academic achievement and high ex- 
pectations in a business-like atmosphere where time 
and resources are efficiently used, learning occurs. 
Every principal must be an outstanding instructional 
leader. TTie principal must have the vision to chart the 
course for the school, and the skills to guide staff, 
students, and the community toward that vision. 
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In Prince George*s County Public Schcx)ls, strong 
instructional leadership is fostered through providing 
regularly scheduled, high level training and constant 
feedback. Every principal goes **back to school*' 
once a month for intensive leadership training. Princi- 
pals come together to work with nationally respected 
consultants and their own peers to enhance their skills 
in all dimensions of leadership. The Principals* Lead- 
ership Training Committee has been formed to ana- 
lyze leadership needs and plan a variety of profes- 
sional development programs to meet these needs. 
Many of the topics included in the Advanced Leader- 
ship Training Program have been directly related to 
Effective Schools Research and implementation. 

Providing School-Based Staff Development 

One of the least popular — and least effective — staff 
training procedures formerly used in Prince George's 
County Public Schools was the **one shot mass 
meeting" where all teachers were given the same in- 
service at the same time. These sometimes frustrating 
and non-productive experiences did little to stimulate 
professional growth. The Effective Schools focus pro- 
vided the impetus to change our staff development ac- 
tivities to combine school based planning with a wide 
selection of offerings from which teachers can select. 
Many staff development activities now occur at the 
school building level. Plans currently underway for 
creative use of cable TV and videotapes will enhance 
our efforts to bring quality inservice programs to the 
building level. 

A directory of ** In-House Consultants** has been 
compiled for reference and use by every school. This 
helpful directory, organized by Effective Schools cor- 
relates, features and nurtures in-house talent for pro- 
fessional growth. 



Impact of the Effective Schools 
Process on Personnel Evaluation 

During the 1987-88 school year the personnel 
evaluation process for principals and central and area 
office staff who work with the instructional program 
was expanded to include the extent to which targeted 
outcomes related to student achievement and atten- 
dance were reached. Additionally, a teacher evalua- 
tion process which includes a section on student out- 
comes was develojxd and has been piloted in eight 
schools. The process involves collaboration on the 
part of teachers and principals in establishing student 
outcome goals at the beginning of the school year, 
and identifying the evaluation procedures to be used 
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to determine if goals had been met at the end of the 
school year. These new approaches to evaluation will 
be carefully monitored to determine what adjustments 
are needed prior to extending their use. 

Impact of the Effective Schools Process 
on Home and Community Involvement 

Guided by the Effective Schools Research which 
emphasizes home, school, and community collabora- 
tion, deliberate efforts have been made to involve par- 
ents and the broader community in the school and the 
school system improvement activities. Examples of 
parent and community involvement which have been 
influenced by the Effective Schools Research are 
summarized below. 

Parent Involvement 

• Parents participate on school planning and manage- 
ment teams and school improvement teams. 

• Weekend conferences and workshops for parents 
have been designed to help parents help their chil- 
dren. 

• Parent representatives are invited to join school 
system committees and task forces. 

• A parent involvement specialist position has been 
created to help school personnel link home and 
school to support students in their instructional 
program. 

• Schools sponsor special programs and activities de- 
signed to involve parents in their children's learn- 
ing. 

Community Involvement 

• The Community Advisory Council advises the 
board of education on desegregation issues, 

• The Community Advisory Board for Suspension 
Reduction examines suspension rates, school by 
school, and offers recommendations. 

• The Business and Industry Advisory Council sup- 
ports the school system with community relations, 
fund raising, teacher recruitment activities, and 
specific instructional imprvovement activities such 
as identification of key employability skills, 

• The Interfaith Advisory Council made up of clergy 
from various denominations within the county 
helps school personnel address issues such as drop- 
out prevention, drug abuse, teen pregnancy, and 
values and ethics in the curriculum. 
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Summary 

As the need for well infornied citizens and a well 
educated workforce increases, one thing is clear: 
Schools cannot do the job alone. Only when schools 
enter collaborative relationships with parents and the 
community can they fully respond to the challenge of 
educating students for the twenty-first century. 



Impact of the Effective Schools Process 
on Programs for "At-Risk" Students 

At the top of the education agenda today is the 
pressing issue of dealing with the **at-risk" student. 
Defined as those students most in danger of failing or 
dropping out of school, **at-risk" students pose the 
greatest single challenge for every school system, in- 
cluding Prince George's. Schools cannot afford to 
lose any students to failure and must reverse the 
alarming increase in the number of students consid- 
ered **at risk.'' 

The Effective Schools process affirms that all stu- 
dents can learn, and illustrates that high expectations 
result in improved achievement. Effective Schools 
Research has influenced how the Prince George's 
County Public Schools work with **at-risk" students 
in two major ways: establishing tiigh expectations for 
all students, including **at-risk" populations and 
strengthening the emphasis on preventing learning 
problems through greater emphasis on meeting stu- 
dents' unique instructional needs in the early grades. 

In Prince George's County Public Schools, a three- 
fold approach to working with **at-risk" students has 
been taken: prevention, intervention, and remediation. 
Our greatest emphasis is on prevention. 

Prevention strategies have included: 

• A strong instructional program with frequent moni- 
toring of student achievement as the single best 
prevention program. 

• A program for four-year-olds in nine elementary 
schools with large numbers of students from low 
socio-economic backgrounds and low achievement 
scores. This has given young children opportunities 
to develop oral language skills, **social skills," 
and familiarity with the school setting. 

• Full-day kindergartens in our predominately bla'^k 
schools (using the Milliken II plan). These have 
given five-year-olds the extra time needed to de- 
velop ''school skills," along with building a solid 
foundation for reading and mathematics. 

• Transition programs in grades K-2 featuring small 
class sizes and intense multisensory instruction for 



students with greatest potential to become * 'at- 
risk." 

Intervention strategies have included: 

• The SUCCESS Program, in intensive academic 
program for grade nine students with highest rates 
of suspension and absence and lowest academic 
achievement. The program has been a promising 
intervention strategy for secondary "at-risk" stu- 
dents. In addition to a strong emphasis on aca- 
demic content, students learn study skills, "coping 
skills," and have the opportunity to participate in 
summer work-study programs. 

• Programs for pregnant and parenting teens to en- 
courage pregnant teens and teen parents to stay in 
school. 

• Special reading programs and Chapter 1 programs 
which give additional assistance to students in 
need of instructional support. 

Remediation strategies have included: 

• Summer programs in math and reading for elemen- 
tary students who have failed or are in danger of 
failing. These have enabled hundreds of students to 
move successfully to the next grade level. 

• After-school workshops for students who have 
failed high school competency tests. These build 
skills in small class settings with active learning. 

• Saturday School offering remedial programs for 
students with academic problems and students 
whose excessive absences demand "make up" 
time. 

• Two vocational high schools with a job-oriented, 
hands-on approach to learning with caring, spe- 
cially trained teachers providing educational op- 
tions for "at-risk" youth. 

In each instance, consistent with the premises of 
Effective Schools Research, programs for "at-risk" 
students are designed to keep students in the main- 
stream or return them to the mainstream classroom as 
soon as possible. 



The Impact of the Effective Schools 
Process on Desegregation 

Blending Effective Schools Concepts 
with Magnet School Choices 

During the 1984-85 school year Prince Hcorge's 
County Public Schools was confronted with new, 
court -ordered desegregation guidelines; no school 
within the system was to have a black student popula- 
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lion exceeding 80 percent or below 10 percent. The 
board of education as well as black and non-black cit- 
izens within the community rejected mandated busing 
as the school system's response to the new guidelines. 
Instead, an instructional alternative — implementation 
of a variety of magnet school programs— was pro- 
posed by the superintendent. Now in their third year 
of implementation, the popular magnet programs have 
been featured in newspapers throughout the nation, 
and have been enthusiastically received by parents. 

Magnet schools are just as intensely involved in 
Effective Schools implementation as are non-magnet 
schools. Magnet programs offer choice, but must be 
characterized by quality and equity as well. Like non- 
magnet schools, all magnet schools have the responsi- 
bility for addressing correlates of Effective Schools. 
Magnet schools have school improvement teams> de- 
velop school improvement plans, establish goals for 
student achievement, and disaggregate data to adjust 
and improve instruction. 

Milliken II Schools Feature a 
Unique Approach to Effective 
Schools Implementation 

Sixteen Prince George's elementary schools with 
populations that fall outside court-ordered desegrega- 
tion guidelines and cannot, at this time, be further de- 
segregated due to demographic factors, have been 
given compensatory resources to eiihance instruction 
for students. Among these resources are computer 
labs, new texts, and a 20 to 1 pupil-teacher ratio. 
Termed Milliken schools after the Governor of Michi- 
gan who worked with a similar desegregation action 
in Dc'iroit in 1976, the Milliken II elementary schools 
implement the Effective Schools process in a special 
way known as the Comer School Development Pro- 
gram. Dr. James Comer, director of the Yale Univer- 
sity Child Study Center Schools Program and a recog- 
nized authority on implementing successful programs 
for minority students, has consulted with Prince 
George's County Public Schools to help develop a 
highly successful program which emphasizes princi- 
ples of child development, high expectations, and ex- 
tensive parent involvement. 

Each Milliken II elementary school h. s a school 
planning and management team which includes parent 
representatives. A calendar of events which involves 
parents in school activities is developed each year to 
foster home-school relationships. To prevent problems 
related to achievement and discipline, as well as to 
provide support for students with special needs, each 
Milliken II school has formed a student staff services 
team (SSST). The SSST promotes a positive school 
climate and works closely with the school planning 



and management team. The school improvement plan 
developed by Milliken II schools focuses on three 
areas: student achievement, school climate, and 
home/school relationships. 



Evidence of School Improvement 

Gains in Student Achievement 

Average student achievement in Prince George's 
County Public Schools has continued lo improve, 
nearing the fourth, or highest quartile on standardized 
achievement measures and reaching or exceeding 
state averages on high school competency exams. Cri- 
terion-referenced test results show steady gains in the 
number of students who demonstrate mastery of es- 
sential objectives. 

Standardized Test Results 

During the 1987-88 school year, third grade stu- 
dents in Prince George's County Public Schools 
moved into the top 30 percent nationally on the Cali- 
fornia Achievement Test by scoring at the 73rd per- 
centile— the first time any grade in the school system 
has surpassed the 70th percentile on the total exam. 
Students in grade five reached the 69th percentile and 
those in grade 8 reached the 67th percentile. (See Fig- 
ures 1 and la.) 

Black students in grades three and five entered the 
top 40 percent nationally by exceeding the 60th per- 
centile on the test for the first time. Black third grad- 
ers scored at the 66th percentile while black fifth 
graders reached the 61st percentile. Black eighth 
graders system-wide scored at the 58th percentile. 

The gains by black students, system-wide, contin- 
ued to narrow the gap between white and black stu- 
dent achievement. The gap was reduced to 17 percen- 
tile points in grade three alone— the first time the gap 
has been less than 20 percentile points. Gains made 
by black students in Milliken II schools were particu- 
larly impressive, exceeding the county-wide average 
as well as the gains made system-wide by black stu- 
dents. Average achievement for white students moved 
into the top 20 percent nationally at all three grade 
levels for the first time. White third graders reached 
the 83rd percentile, while white fifth graders scored at 
the 81st percentile. White eight graders reached the 
80th percentile. 

Results from High School Competency Tests 

Students must pass four high school competency 
tests as part of the graduation requirements for the 
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CALIFORNIA ACHIEVEMENT TEST 
Percentile Scores for Grade Eight 
Black and White Students 



Percentile Rank 




Fall 1984 Fall 1985 Fall 1986 
Year of Testing 



Fail 1987 



Race 
IBlack l223White 



CALIFORNIA ACHIEVEMENT TEST 
Percentile Scores for Grade Five 
Black and White Students 



Percentile Rank 



lOOi^ 




Fall 1984 Fall 1985 Fall 1986 Fail 1987 
Year of Testing 



Race 
IBlack White 



CALIFORNIA ACHIEVEMENT TEST 
Percentile Scores for Grade Three 
Black and White Students 



Percentile Rank 




Fall 1984 Fall 1985 Fall 1986 
Year of Testing 



Fall 1987 



Race 
IBlack Ea White 



Figure 1. California Achievement Test Percentile Scores, Grade 8 
California Achievement Test Percentile Scores, Grade 5 
California Achievement Test Percentile Scores, Grade 3 
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California Achievement Test Percentile Rank Summary, 

Total Battery 




Figure la. California Achievement Test Summary 

State of Maryland. These state-developed tests mea- 
sure student competency levels in reading, writing, 
mathematics, and citizenship. Three of the tests have 
been developed in a multiple choice format, but the 
writing test requires students to write narrative and 
expositviry passages on prescribed topics. Students 
have their first opportunity to pass the tests in grade 
nine and may take the tests each subsequent year until 
mastery is achieved. The results have been positive. 



On the Maryland Test of Citizenship Skills, 
achievement for grade nine black students im- 
proved from 55 percent passing in 1985-86 to 67 
percent passing in 1987-88, and achievement for 
grade nine white students improved from 75 per- 
cent passing in 1985-86 to 80 percent passing in 
1987-88. See Figure 2. 

On the Maryland Functional Mathematics Test, 
achievement for grade nine black students im- 



Black and White Ninth-grade Students who Passed 
the Maryland Test of Citizenship Skills, 1986-1988 



Percentile Passing 
100 -r 




80 



80 




Black White 
1985-86 



Black White 
1986-87 



Black White 
1987-88 
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Figure 2. Black and White 9th Grade Students' Results: Maryland Test of Citizenship 
Skills 
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The Maryland Functional Mathematics Test Black 
and White Ninth-grade Students Who Passed, 
1985 1988 



Percentile Passing 
100- 



80- 
60- 
40- 
20- 



79 



68 



70 




Black White 
1985-86 




Black White 
1986-87 




Black White 
1987-88 



Figure 3. Maryland Functional Math Chart 



The Maryland Functional Reading Test Black and 

White Ninth-grade Students Who Passed, 
1985-1988 



100 



Percentile Passing 
96 



Black White 
1985-86 




Black White 
1986-87 



Black White 
1987-88 



Figure 4. Maryland Functional Reading Test Chart 



proved from 43 percent passing in 1985-86 to 56 
percent passing in 1987-88, and achievement for 
grade nine white students improved from 68 per- 
cent passing in 1985-86 to 79 percent passing in 
1987-88, as shown in Figure 3. 



Grade nine black students who passed the Mary- 
land Functional Reading Test increased from 88 
percent in 1985-86 to 91 percent in 1987-88. See 
Figure 4. 
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A Comparison of Black and White Ninth-grade 
Student Performan ce on the Maryland Writing Test 

Percentile Passing - Grade Nine 



100 




1984-85 1985-86 1986-87 1987-88 



Figure 5. Comparison of Black & White Students' Results 



• Grade nine black students who passed the Mary- 
land Writing Test increased from 41 percent in 
1984-85 to 89 percent in 1987-88, while the num- 
ber of white students who passed the test increased 
from 59 percent to 95 percent during the same pe- 
riod. See Figure 5. 

Strength and Presence of 
Correlates of Effective Schools 

An Effective Schools AudU Advisory Team pro- 
cess was developed as a monitoring strategy to give 
feedback to schools concerning the extent to which 
their school improvement activities are being imple- 
mented as described in their school improvement 
plans. The audit advisory process also provides a 
measure of the strength and presence of the correlates 
of Effective Schools within the schools and the school 
system. 

Each audit advisory team is chaired by a principal 
and includes classroom teachers and a central or area 
office representative. The team spends one day in a 
school, interviewing the principal and staff, visiting 
classrooms, and reviewing data. The team prepares an 
audit report which gives feedback to the principal and 
staff. Problem areas are identified and a plan to ad- 
dress these areas is developed by the principal and 
school improvement team. 

During the 1987-88 school year, 37 schools were 
visited by an audit advisory team. Reports from the 
visits indicated the level of staff awareness of the Ef- 
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fective Schools Research and process; the degree of 
involvement staff members felt they had in develop- 
ing their school's improvement plans; and the extent 
to which staff members felt they were actively partic- 
ipating in the implementation of the process. 

Data from the audit reports indicated that in over 
95 percent of the audited schools, staff awareness of 
the Effective Schools Research and process was evi- 
dent. Similarly, staff involvement in development of 
school improvement plans was evident. The widest 
range of responses occurred with questions that fo- 
cused on the staffs' active participation in the imple- 
mentation process, particularly in the classroom set- 
ting. Later, audit report data are used by individual 
schools to assist school personnel in refining the im- 
plementation process within their school. 

Resolving Concerns Related to Effective 
Schools Process Innplennentation 

As The Effective Schools process was imple- 
mented in Prince George's County Public Schools, 
several issues and concerns emerged. A summary of 
these issues and a description of how the issues were 
resolved is presented below: 

Gradual va Total Syatem Implementation 

Issue: Should the Effective Schools process be imple- 
mented gradually, school by school, over an ex- 
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tended period of time, or should a system -wide 
commitment to implementation be made from the 
outset? 

Resolution: Early in the implementation process a 
commitment to system-wide, rather than school by 
school implementation, was made due to the sig- 
nificant impact the process could make for all stu- 
dents. 

The Mission vs the Means 

Issue: How can the school system keep a strong 
focus on the message and mission of Effective 
Schools — quality and equity, and not confuse the 
means to reach the ends, the Effective Schools cor- 
relates, with the ends themselves? 

Resolution: During the first two years of Effective 
Schools process implementation, school improve- 
ment plans were built arpund implementation of 
the correlates of Effective Schools. With such an 
intense focus on the correlates, the means to 
achieve the goals of quality and equity became 
confused with the goal itself. This issue was re- 
solved in part by changing the focus of school im- 
provement plans from implementation of correlates 
to development of long range goals related to stu- 
dent outcomes, and by renewed emphasis on qual- 
ity and equity. 

Dynamic vs Static Process 

Issue: Must all parts of the implementation plan be 
"in place** before a system-wide commitment is 
made to implement the Effective Schools process? 

Resolution: As stated above, at the time Prince 
George's County Public Schools implemented the 
Effective Schools process, there was little research 
to guide school systems in ways to establish a total 
commitment to accomplish implementation. The 
resulting implementation process has been a dy- 
namic — but sometimes fragmented — one. Because 
some features of accomplishing implementation 
were incorporated after the initial introduction to 
the process (e.g., audit advisory teams, outcomes- 
based planning, steering committee guidance), it 
was sometimes confusing to school-based educa- 
tors exactly what was meant by the Effective 
Schools process. In spite of the issues raised by 
this * 'dynamic" implementation process, the pro- 
cess has been successfully implemented and has 
had a profound impact on the total instructional 
program. 



Local School Decision-Making 
vs School System Priorities 

Issue: How can a balance between local school deci- 
sion-making and school system priorities best be 
reached? 

Resolution: School system priorities and local school 
priorities have become much more closely matched 
as a result of Effective Schools process implemen- 
tation. Effective Schools Research provides a mis- 
sion, a common language, and a collaborative im- 
plementation process for the entire school system. 

Time for Planning vs Time for Teaching 

Issue: How can sufficient time for school improve- 
ment teams to meet be provided? 

Resolution: Finding time for school improvement 
teams and total school staffs to meet for planning 
and staff development has been an ongoing chal- 
lenge. The issue of time was partially resolved 
through creating four "early closing** staff devel- 
opment days in the school calendar when school- 
based development activities related to Effective 
Schools were scheduled. 

Process vs Outcomes 

Issue: To what extent should the success of school 
improvement efforts be determined by the process 
followed and to what extent by outcomes reached? 

Resolution: During the four years Prince George's 
County Public Schools has been involved with the 
Effective Schools process implementation, the pro- 
cess vs. outcomes discussion has surfaced in many 
forms and in a variety of settings. Educators tradi- 
tionally have been process oriented. Although pro- 
cess is important, the Effective Schools Research 
clearly points to student outcomes as the final in- 
dicator of i,uccess. Prince George's County Schools 
has addressed the process vs. outcomes issue by 
demonstrating how the process becomes the means 
to the desired ends of positive student outcomes. 

Effective Schools as Schools 
of the Future 

Effective Schools Research points educators in the 
direction of school-based decision making and school- 
based management. Prince George's County Public 
Schools is looking toward the year 2000 with a new 
initiative called Project 2000 — an invitation to ten 
schools to create a vision of education for the future. 
Principals and teachers participating in Project 2000 
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are exploring questions such as these: Given what we 
know about the projected student population for the 
twenty-first century, how should we organize for in- 
struction? How should we staff our schools? How do 
we create teacher leadership? How do we meet the in- 
creasingly diverse needs of students? How can home 
and school be linked so closely that one is an exten- 
sion of the other? How can schools capitalize on the 
advancements in technology to improve instruction 
for all students? How might the traditional school 
year and patterns for school organization change? 
However these questions are answered, one thing is 
certain — schools of the future must be Effective 
Schools. 



Summary 

A clearly defined mission and school system im- 
provement goals, higher levels of student achieve- 
ment, positive results from audit advisory team visits, 
increased accountability, greater levels of teacher in- 
volvement in decision-making, and implementation of 
an instructional management system with criterion- 
referenced tests are some of the many indicators that 
the Effective Schools process is well on its way to- 
ward full, successful implementation in Prince 
George's County Public Schools, and most signifi- 
cantly, to improve the achievement of minority stu- 
dents. 
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Appendix A 



Chorocteristics of on 
Effective School System 



As noted earlier, until recently research has focused on what makes a 
school building effective without regard to the contributions that the 
rest of the system makes toward achieving that effectiveness. The 
following are characteristics that the system must have in order to 
support, reinforce, and help guide the process at the local building 
level. 

• Strong, instructionally focused leadership 

• Clear and focused mission 

• Frequent monitoring of student progress 

• Climate of high expectations for success for all students and staff 

• Purposeful and supportive involvement of parents, other citizens, 
and business and community groups 

• Curriculum and instructional programs that assure opportunities for 
every student to learn 

• Support for schools to assure a safe and orderly learning 
environment for students 

• High rate of attendance for students and all school and non-school 
based staff 

• Strong staff development program which reflects and supports the 
implementation of the Effective Schools process 

• Clear understanding on the port of all staff as to their specific roles 
and responsibilities in contributing to the Effective Schools process, 
and an evaluation process which supports this understanding. 

On the following pages are specific implications for planning and 
action which must be considered by any school system engaged in 
the school improvement process. 
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Characteristic Implications for Planning and Action 



Strong, Instructionally focused 1. The superintendent of schools assures that a school sys- 

leadership tern plan for implementing the Effective School Process is 

developed and assigns responsibilities for implementing 

the plan. 

2. Associate superintendents assure that resources within 
their divisions support school by school implementation of 
Effective Schools School Improvement Plans. 

3. Assistant superintendents assure that each school in their 
administrative area develops and implements a school 
improvement plans. 

4. Subject area supervisors and program coordinators pro- 
vide assistance to schools in implementing school im- 
provement plans as the schools define a need for such 
assistance. 

5. Subject area supervisors and program coordinators pro- 
vide assistance to schools in implementing school im- 
provement plans as the schools define a need for such 
assistance. 

6. Principals provide leadership for and assure staff partici- 
pation in developing, implementing, monitoring, and 
evaluating their local school improvement plan. 

7. An Advance Leadership Training Program provides princi- 
pals with information required to develop and maintain 
an Effective Schools Program within their buildings. 

8. A Pre-Leadership Training Program provides professional 
employees who aspire to positions of leadership with in- 
formation related to implementation of the Effective 
Schools process at the local school leveL 

9. A variety of staff development programs is available for 
teachers to strengthen their instructional expertise in as- 
suring that all students learn the essential curriculum. 



Cleor and focuses mission 



ERIC 



1. A school system mission statement is developed which in- 
cludes the expectation that all students will learn the es- 
sential curriculum, and highlights characteristics of Effec- 
tive Schools as a means to reach that end. 

2. The school system Strategic Management Plan includes 
school system improvement goals that define high ex- 
pectations for all students and reflect focus on quality 
and equity. 

3. School system policies and administrative procedures are 
reviewed on o regular basis, and strengthened or ad- 
iusted as needed, ♦o increase support for the school 
system's mission and improvement goals. 

4. Goals and objectives for each division within the school 
system clearly reflect and support the school system mis- 
sion and improvement goals and priorities identified from 
local school improvement plans. 

6. Eoch school develops its statement of mission and goals 
which reflect the school system mission and improvement 
goals. 
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Characteristic 



Implications for Planning and Action 



6. Each school has a school improvement team represent- 
ing the entire staff of the school which guides the school 
improvement process within the school. 

7, Each school improvement team, with staff Input and in- 
volvement develops a school improvement plan that 
provides direction in accomplishing its mission and reach- 
ing its goals. 



Frequent monitoring of student 
progress 



1. Criterion-referenced tests based upon essential curricular 
objectives are developed for all grade levels, and used 
in a manner designed to enhance the learning process. 

2. Data from system-wide achievement measures are pre- 
pared in disaggregated form to facilitate planning for 
program development or adjustment, and are provided 
for schools in a timely manner. 

3. Data are provided to assist local school personnel In ana- 
lyzing relationships between student achievement and 
the instructional delivery system within the school. 

4. Student grade distributions, analyzed by sex, race, and 
attendance, are provided to secondary schools to assist 
in assessing the day-to-day impact of the instructional 
program as evidenced by student achievement. 

5. Assistance with interpreting and using disaggregated stu- 
dent achievement data to improve instruction are pro- 
vided for principals and staff. 

6. Classroom observations and follow-up conferences pro- 
vide teachers with opportunities to analyze the Impact 
on student achievement of selected Instructional strate- 
gies used for classroom instruction. 

7. School Instructional teams and/or supplemental services 
teams (SiT/SST) assist in identifying student needs and 
planning appropriate instructional adjustments. 

8. Case review teams provide monitoring and assistance 
with program planning for students with identified needs 
beyond their present placements. 

9. Psychological services personnel provide classroom obser- 
vations and consultations with teachers. 



Climate of high expectations for 
success for all students and staff 



1. The school system mission statement states that all stu- 
dents wHI learn the essential curriculum. 

2. The school system develops improvement goals which 
clearly reflect quality and equity, 

3. Staff development programs are established to help prin- 
cipals and teachers identify the relationship of high ex- 
pectations to success, ways to communicate high ex- 
pectations to all students and staff, and strategies to 
help different types of learners succeed. 
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Characteristic Implications for Planning and Action 



4. The school system's curriculum presents clearly stated ob- 
jectives which challenge students to achieve at optimum 
levels. 

6. Programs are in place which meet the special needs of 
students so oil may learn the essential curriculum. 

6. Teachers and guidance personnel encourage students to 
enroll In more challenging courses to promote optimum 
achiev'ement and opportunities for all students. 

7. '''eacher recruitment efforts focus on identifying prospec- 
tive teachers who have or wish to develop proficiency in 
assuring that all students learn the essential curriculum. 



Purposeful and supportive 
involvement o^parents, other 
citizens, and business and 
community groups 



1. Parents (citizens) are included on major school system 
committees, task forces, and advisory councils. 

2. Parents (citizens) assist with selection of instructional ma- 
terials. 

3. Members of the business and industry community are in- 
vited to provide input for school system instructional and 
management planning. 

4. Parents are given assistance in supporting their children's 
learning through specially designed programs and mate- 
rials. 

6. Parents are represented on school improvement teams 
and school planning and management teams. 

6. Support is provided for schools to develop "social 
calendars" of events which encourage parent participa- 
tion/involvement. 

7. The school system offers parents/guardians a "system of 
choices" so they have an opportunity to select from a 
variety of educational alternatives those most appropri- 
ate for their children. 

8. Parents (citizens) are encouraged to complete system- 
wide surveys to evaluate programs of the school system. 

9. Parent/teacher organizations are made aware of and en- 
couraged to participate in the Effective Schools process. 

10. Parents are made awcre of and encouraged to partici- 
pate in educational and career planning activities. 

11. Members of the business and industry community are in- 
vited to provide information for students about careers 
and job-seeking skills. 



Curriculum and instructional 
programs that assure opportunities 
for every student to participate 
and to learn 

2. Programs are in place to support the special needs of 
students. 



1. The school system's mission and instructional goals are 
clearly reflected through well designed curriculum docu- 
ments which are provided for every teacher In the sys- 
tem. 
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Characteristic 




Impiications for Planning and Action 






• Special Education 






• ESOL 






• TAG 






• Chapter 1 






• Head Start 






• State Compensatory Education 






• Project SUCCESS 






• Vocational High Schools 




3. 


Magnet programs are offered in response to students' 
special interests and needs and reflect quality and equity 
by design. 




4. 


Course offerings are provided which meet students' cur- 
rent skill levels and challenge them to reach and aspire 
to high levels of achievement. 




5. 


The school system curriculum assures systematic instruc- 
tion In basic skills for all students. 




6. 


The school system curriculum promotes devetopment of 
higher order thinking skills for all students. 




7. 


High quality, current instructional materkils are provided 
for schools. 




8. 


All curriculum and instructional materials support instruc- 
tion that is multicultural. 




9. 


Resource assistance Is orovidpd fnr npw nnH pvnpripnr'pH 
staff to assure that appropriate instruction in the essential 
curriculum is provided for all students. 




10. 


Workshops which include correlates and processes of Ef- 
lecTive ocnoois impiernenTaTion are provtoeo to asstsT 
and support those teachers who are new to the profes- 
sion or to the schools system. 




11. 


vided for schools to use in adjusting and enhancing cur- 
riculum and instructional programs for students. 


Support for schools to assure a 


1. 


A code of student conduct is established and communi- 


safe and orderly learning 




cated to students, parents, and the community to help 


environment for students 




schools promote a safe and orderly learning environ- 
ment. 




2. 


Pupil Services' support is readily available to schools to 
assist with implement of school improvement plans. 




3. 


Alternative programs are provided for students with spe- 
cial needs. 




4. 


The Supporting Services Division collaborates with schools 
to help them develop and maintain preventive mainte- 
nance programs which are part of a safe and orderly 
environment. 




6. 


The Supporting Services Divisk^n colkaborates with area 
assistant superintendents and local school principals in 
enhancing the physical teaching-learning environment. 




6. 


Pupil Services personnel support school staffs in efforts to 
eliminate distractions that interfere with learning. 
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Characteristic ImpHcaflons for Planning and Action 



High rate of attendance for 1. The relationship between student and staff attendance 

students and all school and and student achievement Is clearly recognized and doc- 

non-school based staff umented. 

2. Programs are In place which appropriately address 
students' learning strengths and needs. 

3. System-wide and school-by-school attendance data for 
students and staff are provided on a regular basis. 

4. Working conditions promote a high level of staff interac- 
tion and involvement. 

5. Procedures are in place to communicate with families of 
students with frequent absences. 

6. Pupil Services staff are available to assist schools with 
identified school attendance problems. 

7. Pupil Services staff are available to assist in developing 
and implementing preventive strategies that result in Im- 
proved student and staff attendance. 



1. An orientation program which features elements of the 
Effective Schools process is provided for staff new to the 
school system. 

2. Pre-Leadership Training Programs, and Advanced Leader- 
ship Training Programs which feature elements of the Ef- 
fective Schools process are provided. 

3. Each department and division within the school system 
arranges appropriate staff development programs that 
feature elements of the Effective Schools process. 

4. School-based stoff development programs which feature 
elements of the Effective Schools process are provided 
during the school day. 

5. Staff development councils that include representatives 
from every school provide input for system-wide staff de- 
velopment acYivities which support elements of the Effec- 
tive Schools process. 

6. School-based staff development coordinators are mem- 
bers of their respective school improvement teams and 
provide linkage for staff development initiatives and 
school improvement efforts. 

7. A directory of staff development resources is developed 
by the Department of Staff Development and made 
available to all schools. 

8. School system support for inservice needs identified in 
school improvement plans is provided. 



Clear understanding on the part of 1. The superintendent of schools arranges for system-wide 

all staff as to their specific roles implementation of the Effective Schools process and 

and responsibilities in contributing identifies resources needed in support of the process, 
to the Effective Schools process 



Strong staff development program 
which reflects and supports 
implementation of the Effective 
Schools process 



Prince George's County 
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Characteristic implications for Planning and Action 



2. Each non-school based division, department and office 
defines its roles and responsibilities in contributing to the 
Effective Schools process In the form of a written docu- 
ment widely circulated throughout the school system. 

3. Each local school, through its school improvement team, 
Identifies roles and responsibilities of local school person- 
nel in implementing the Effective Schools process. 

4. A system-wide Effective Schools implementation Plan is 
developed which summarizes the specific roles and re- 
sponsibilities of all staff in contributing to the Effective 
Schools process. 

5. A system-wide Effective Schools Audit/Advisory Team Pro- 
cess is established which assists schools to monitor and 
adjust Implementation of school improvement plan. 

6. Standards for Excellence which reflect the Effective 
Schools process and outcomes are developed for all 
staff and form the basis for all staff evaluations. 

7. A continuing staff development program is In pkace 
which Introduces new employees to the Effective Schools 
process. 

8. AH components of the school system collaboratively work 
to fulfil the school system's mission and reach its improve- 
ment goals. 
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Norfolk Public Schools 

Became involved In Effective Schools process in 1982 



Community 

Populotlon 

276,000 

Urban. Economic 
base — military, coastal and 
harbor occupations, light 
industry. World's largest naval 
base, inner city under 
reconstruction with 
middle/upper income homes, 
landmark case in bussing for 
desegregation. 20 percent 
military — highly transient. 

Predominantly middle class 
68 percent white, 38 percent 
black, 64 percent qualify for 
free-and-reduced lunch. The 
black/white ethnic 
composition of the school 
division is just the opposite of 
that of the city. 



School District 



Enrollment 

36,000 

Ethnic Composition, (percent) 

African- Am erican 68.0 

American Indian .1 

Asian-American 3.0 

Caucasian 38.0 

Hispanic .9 



Per Pupil Expenditure 

\9%&-%l $3,854 

1987- 88 4,139 

1988- 89 4,303 



Areo (in square miles): 

64 

Schools 

Elementary schools 37 

Middle schools 8 

High schools 1 

Other— Vocational 1 

— Pregnant teens 1 

— Sev. handicap 3 

— Skills center 1 

—Sifted alter. 1 

Number of Staff 

Administrators 206 
(100 principals, 106 central) 

Certified Teachers 2,600 

Support staff 1,794 

Student-Teacher Ratio 

Elementary 23.6:1 

Middle 24.0:1 

High 22.2:1 



Percent bussed Percent college-bound 

47 (approx.) 

62 



Abstract 



Although many components for school dis- 
trict improvement were in place when Norfolk 
Public Schools embarked on the Effective 
Schools process in 1981-82, without SPIRAL (Sys- 
tematic Process lor Instruction, Remediation, 
and Acceleration of Learning), based on the 
ESR framework. Increased achievement for all 
students may not have become a reality. 

A comparison of the district and schools' in- 
volvement in * 'effectiveness activities," and the 
systematic management of the school improve- 
ment process components implemented in 
1982, are described in this case study. 

Innovative staff development programs are 
at the heart of the Norfolk Effective Schools 
process, with a wide variety of training pro- 
grams utilized to address the needs established 
by school faculties and the district's staff devel- 
opment department. 

Norfolk, like Prince George's County, estab- 
lished a comprehensive system that tended to 
keep the school improvement effort mobilized 
no matter how the political, economic, or com- 
munity environment changed- around it. Prince 



George's was able to go forward in spite of 
negative connotations of a desegregation 
compliance order. Norfolk continued its school 
improvement efforts in spite of the fact that 
poor neighborhoods were demolished and re- 
placed by neighborhoods of middle- and 
upper-income families. This led to the reestab- 
lishment of "neighborhood elementary 
schools," which meant over one-third of the 
schools were comprised of poor and predomi- 
nantly black students. Norfolk treated this devel- 
opment as a challenge, and continued to 
move forward toward **teaching for learning for 
all children." 

The importance of a new set of beliefs which 
staff, administrators, students, and parents must 
share that *'all children con learn" is well artic- 
ulated in Norfolk Public School's report. This be- 
lief set flows from decisive, positive actions on 
the part of all constituencies, documented re- 
sults, and collaborative planning, teaching, and 
learning in the district and the schools. From the 
new belief system and incisive actions commit- 
ment to the Effective Schools process is real- 
ized. 
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Success for All Children 

Imagine a school where each child experiences 
success daily. Visualize the teachers of these students 
happily discussing creative ways to make learning rel- 
evant and ardently seeking avenues for students to 
apply what they learn. Also listen with your mind's 
ear to the principal, members of the faculty and staff, 
several central office support staff members, and two 
parents gathered around a conference table in the 
bright, sunlit media center. They are generating ideas 
for a master plan that will move the school closer to 
the descriptors used to define an effective school. 
Two key words heard throughout their discussion are 
**equity" and **quality.** Their conversations focus 
on where the school stands in relation to providing 
educational opportunities for all students that reflect 
both terms. This is the goal for each of the 53 schools 
that comprise the Norfolk Public Schools System. 

The Norfolk (Virginia) Public Schools Sys- 
tem serves 36,000 students in an elementary (pre-K- 
5), middle (6-8), senior high (9-12) organizational 
selling. Additionally, a technical vocational center, an 
outdoor education camp, and several supplementary 
facilities offer alternative programs for students with 
special needs. 

Norfolk is a highly transient, urban city which 
houses the world's largest naval base. The district has 
diverse socioeconomic strata. The city is 58 percent 
white; the school system is 58 percent black and 42 
percent white or other. Approximately 44 percent of 
its students are from middle to upper income families; 
56 percent are from the lower socioeconomic stratLim. 
Of the families in the district, 20 percent are from a 
highly transitory military population. 

The school system welcomes the challenge inher- 
ent in its mission to provide a quality educational pro- 
gram that is equitable for each of its students. In fact, 
its mission is thai **A]1 students will master the estab- 
lished educational objectives required for graduation 
with no differentiation in the proportion of students 
demonstrating mastery of the essential educational ob- 
jectives among the various socioeconomic levels." 
SPIRAL (Systematic Process for Instruction, Remedi- 
ation and Acceleration of Learning) is the school im- 
provement process to be described. It provides the 
means for answering the question. Can a large, com- 
plex, inner-city school system which serves a highly 
transient and relatively low socioeconomic population 
make equity and quality a reality? 

What follows is an overview of the progress the 
school system has made since its implementation of 
the system-wide school improvement process in 
1981-^2. Next, the process will be explained; finally, 



recommendations for initiating, refining, or extending 
a school improvement process are offered. 

It must be mentioned first and foremost that 
**equity" does not mean equal, and **quality*' does 
not mean the 50th percentile on standardized tests. 
Equity, by NPS definition, means that resources and 
opportunities are based on need; quality is a direction 
partially measured by test scores reflecting a steady 
increase over time. Both provide each student the 
greatest number of options when exiting school. With 
this clearly in mind, it is evident that never before has 
there been such a deliberate and unified effort to en- 
sure that all students succeed, regardless of previous 
academic performance or socioeconomic status. 

What has this done for the mission of teaching and 
learning? The results speak for themselves. The bot- 
tom line is increased student achievement, higher em- 
ployee personal efficacy, and a more satisfied parent 
and community population. In fact, in a 1988 national 
poll conducted by the University of Kentucky, Nor- 
folk, Virginia, was cited as being the second most de- 
sirable place to live in the United States. It goes with- 
out saying that the public schools play a big part in 
public opinion about a particular demographic area. 

Highlights of the progress made toward equity and 
quality since 1982 are reflected in the representative 
graphs included in this chapter. These constitute evi- 
dence that schools arc improving. For the first time in 
over a decade, composite scores on standardized tests 
system-wide are at or above the national norm at 
every grade level tested, and are maintaining an up- 
ward trend. Criterion-referenced test results show sim- 
ilar gains. The retention and dropout rates have been 
reduced significantly, and the percent of high school 
graduates continues to rise in spite of increased re- 
quirements for graduation. Attendance and discipline 
at all . grade levels have improved. The number of 
schools meeting the criteria for effectiveness is also 
increasing. 

A number of distinguished awards and commenda- 
tions have been bestowed upon the school system for 
its systematic efforts to implement Effective Schools 
Research. The school improvement process has been 
featured nationally in publications and at conferences 
(American Association of School Administrators 
(AASA), Virginia Association of School Administra- 
tors (VASA), Virginia Association of Supervision and 
Curriculum Development (VASCD), and NASCD, 
National Staff Development Conference, The Effective 
School Report, HRD^P). It is recognized as an exem- 
plary model for school improvement by the National 
Center for Effective Schools Research and Develop- 
ment, The process is a major component in the staff 
development model which received one of AASA's 
nineteen National Exemplary Staff Development 
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Awards in 1987. SPIRAL has received Excellence in 
Education Awards from Virginia Polytechnical Insti- 
tute in the areas of staff development, dropout reduc- 
tion, new teacher orientation, and community involve- 
ment. (NORSTAR, a collaborative program between 
the schools and governmental community, is also rec- 
ognized in the American School Board Journal Exec- 
utive Educator,) AASA selected Dr. Gene R. Carter, 
superintendent, as its first National Superintendent of 
the Year in 1987-^8. Moreover, both the elementary 
and secondary State Principals of the Year are mem- 
bers of the NPS team. 



How Have These Results Been Attained? 

Prior to the implementation of the systematic pro- 
cess for system-wide school improvement, many Ef- 
fective Schools activities took place. Locally gener- 
ated performance-based curriculum guides and 
criterion-referenced tests were available. Continuous 
coaching of teachers and administrators in the appli- 
cation of the effective teaching research received top 
priority. A promotion/retention criterion had been es- 
tablished and a task force formed to study the dropout 
problem. The school division participated in both the 
state and the Southern Association of Colleges and 
Schools (SACS) Accreditation programs. A system- 
wide Six-Year Improvement Plan was in place and re- 
viewed annually. However, without SPIRAL, many 
efforts became fragmented and the focus (mission) 
became diffused. 

In 1981-^2 the school board, in conjunction with 
the superintendent, established several priority goals 
for the system. The development of a comprehensive 
system -wide school improvement plan, to be funded 
by the regular operating budget, was one of these 
goals. Under the direction of the superintendent, with 
the support of the school board, and guided by the re- 
search of the late Professor Ronald Edmonds and Dr. 
Lawrence W. Lezotte, the members of the NPS 
School Improvement Planning Committee (i.e., teach- 
ers, principals, administrators, classified staff, parents, 
and members of the community) structured the SPI- 
RAL plan. It was designed to provide an educational 
program of the highest quality for each student. Im- 
plementation would be system-wide, beginning first in 
each of the 40 elementary schools in 1983. Because it 
produced highly favorable results in 1985, it was ex- 
tended to include the system's five senior high 
schools and vocational education center. In 1987 the 
eight middle schools became involved. The middle 
schools were last in the evolution cycle because the 
district was in the process of transition from a junior 
high school organization to a middle school configu- 
ration. 



ERLC 



Norfolk's school improvement plan was structured 
to be consistent with the "correlates" identified in 
Effective Schools Research as being characteristic of 
typical Effective Schools. 

1. A system-wide mission is clear and focuses on 
teaching and learning. It incorporates the belief 
that all students can learn. 

2. The principal is a strong instructional leader and 
an effective and competent manager. 

3. Staff members hold high expectations for the 
educational accomplishments of their students 
and for themselves. 

4. A safe, orderly, caring, goal-oriented environ- 
ment is essential to teaching and learning. 

5. Acquisition of essential skills takes precedence 
over all other school activities. 

6. Frequent and thorough monitoring of student 
performance is required and results are used to 
make educational decisions. 

7. Parent and community involvement is actively 
sought. 

8. Human, fiscal, and physical resources are equi- 
tably distributed among the schools and tailored 
to students' needs. 

The system-wide implementation plan follows this 
process: Need — School Board/Superintendent Goals — 
System-wide Planning Team — Cadre Training in 
awareness of the Model — Needs assessment — Inbuild- 
ing and System-wide Staff Development Commit- 
tees — Staff Development (Awareness, Training) — 
School-based Implementation — Evaluation — Curricu- 
lum/Testing/Staff Development Alignment-on-Mainte- 
nance — Extension — Celebration — Continuous Assess- 
ment of Need, Planning, Implementation — Need, 
Planning, Implementation. 

The thrust has been on improving schools from 
Mthin, one at a time. The district-level coordination 
team consists of the superintendent, a principal, and 
the directors of human relations/staff development, in- 
struction, and research/testing/statistics. Coordination 
responsibilities fall within the parameters of their reg- 
ular duties. 

Each principal establishes a school improvement 
planning committee to coordinate the school improve- 
ment process, and to write the annual school improve- 
ment plan. Although a smaller steering committee 
leads the process, larger correlate committees are also 
established to make shared leadership effective. 
Teachers, classified and support staff, parents, mem- 
bers of the community, students (at secondary levels), 
and central office support staff are members of these 
committees. Every employee has a part in the joint 
effort to create equity and quality in an optimal teach- 
ing, learning, and caring environment. The Annual 
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Schcx)l Improvement Plan is developed by the staff, 
guided by the school board's goals, the superin- 
tendent's objectives (upgraded annually), state stan- 
dards of quality and accreditation, results of the needs 
assessment (conducted every three years), and analy- 
sis of the disaggregated student achievement, atten- 
dance, and computerized data (provided annually). 
The plan and its results form the basis for discussion 
in the semiannual interviews conducted by the super- 
intendent with each principal. In this sense, the Effec- 
tive Schools process can be described as a **top 
down-bottom up" process. 

The Effective Schools thrust has had a tremendous 
impact on curriculum, staff development, program im- 
plementation and evaluation, personnel evaluation, 
and the general practice of running schools. The stu- 
dent, and what is best for him or her, is the pivotal 
point of reference for all decisions regarding the 
aforementioned areas. Some of the primary changes 
will be described now in the sections that follow. 



Measurement of Student Achievement 

Test results are now disaggregated by SES (socio- 
economic status). Standardized and criterion-refer- 
enced test scores are administered at every grade 
level, not just those designated by the Virginia State 
Department of Education. In the area of communica- 
tion skills, criterion-referenced tests are now adminis- 
tered quarterly, rather than twice a year. Analyses of 
test results provide the basis for determining instruc- 
tional priorities. 

How well is Norfolk doing? Some representative 
results show steady gains. Figure 1 shows increases in 
composite SRA scores for grades 2, 4, 6, 8, and 11; 
increases from 1982 to 1987 range from 5 percent to 
17 percent. Figure 2 illustrates the increases achieved 
by grades 1, 3, 5, and 7 from 1983 through 1988. In- 
creases ranged from 1 percent to 15 percent. Not only 
has student achievement improved notably, but the 
dropout rate (see Figure 3) has decreased markedly, 
from 15.8 percent in 1980-^1 to 8.1 percent in 1987- 
88. In addition, need for formal disciplinary proce- 
Jures (including suspensions and expulsions) has de- 
creased. Figure 4 reports heartening progress in 
preventing disciplinary problems and in more effec- 
tively handling problems that arise. 

Curriculum and Instructional Management 

Norfolk Public Schools incorporates the belief that 
schools can and will make a difference in the learning 
process and that all students can and will learn. There 
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must be congruence among written, taught, and tested 
curriculum. A standardized method for curriculum de- 
velopment, based on the Quality Control Triangle cre- 
ated by Dr. Fenwick English of the University of Cin- 
cinnati, is being implemented to produce an effective 
instructional management system. 

Norfolk has implemented SPIRAL (Systematic 
Process of Remediation and Acceleration of Learn- 
ing), a strong alternative program for remediation of 
essential skills of students at all levels. Unique pro- 
motion options exist for elementary and middle 
school students previously retained. These students 
may join their former peers at midyear or at the end 
of the year if they have demonstrated the competen- 
cies needed to be optimally successful at that grade 
level. Teachers of these classes are carefully selected 
because of their previous success rates with lower 
achievers. These teachers also receive intensive and 
specifically tailored inservice training to increase their 
probability of success. SPIRAL was designed in Nor- 
folk to help teachers be more effective with at-risk 
students. SPIRAL teachers learn to use five to six 
major approaches to teaching the existing curriculum. 
SPIRAL training includes mastery of the T£SA 
(Teacher Expectation and Student Achievement), mo- 
dality-based instruction, experience in how to plan 
and deliver interdisciplinary studies (including coordi- 
nation of objectives across the disciplines), training in 
reinforcement theories, cooperative learning (with 
special attention given trust-building skills), study 
ways to raise student expectations, and organizational 
skills (because some at-risk students are very disorga- 
nized), creative discipline (using ideas from Lee 
Canter and Associates and other consultants, such as 
posted rules, positive and negative consequences, 
school-wide support for consistency, parent involve- 
ment), intensive instruction using the Effective Teach- 
ing Model (Madeline Hunter), training in how to 
teach students to keep records of their own progress, 
and how to use test data in making instructional deci- 
sions. Many regular teachers apply to take the train- 
ing out of a desire to improve their effectiveness. 

The need for SPIRAL-trained teachers is declining, 
a sign of success. More teachers than are needed 
apply to take SPIRAL training. When the SPIRAL ef- 
fort began, the school district identified eleven 
schools, largely in poorer neighborhoods, and system- 
atically trained teachers to teach in those schools. 
Every year staff members conduct a needs assessment 
and talk over how problems were solved and how to 
solve remaining problems. 

A longitudinal study of the results of student per- 
formance over time, 1983-87, clearly provides evi- 
dence that continued student success is maintained. 
Not only has the total number of SPIRAL-taught stu- 
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COMPOSITE SRA SCORES 

+11% +13% +5% +6% +17% 

67% 




COMPOSITE SRA SCORES 

+15% +10% +7% +1% 
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Figure 4. Need for Formal Discipline 



Mid- Year Spiral Class Promotions 

1983-84 through 1986-87 
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Figure 5. Mid-Year SPIRAL Class Promotions, 1983-^ through 1986-87 



Spiral Class Students 
Who Rejoined Peers 
Total 1,297 over 4 years 




Figure 6. SPIRAL Class Students 
Who Rejoined Peers, Total 1,297 
over 4 years 



dents dropped, but the percentage of students who 
join their peers is increasing. Figure 5 shows the con- 
sistent trend. Additional students rejoin their peers 
after a full year in the SPIRAL program rather than at 
mid-year. In the long run the SPIRAL program saves 
money and enables more students to be successful. 
This program also keeps some students from dropping 
out. (Figure Z) 

Norfolk teachers and administrators are pleased 
that 72 percent of the SPIRAL students have success- 
fully rejoined their peers and have not repeated being 
retained. (See Figure 6.) 

Schools where the student population consists of 
predominantly low-income families have been identi- 
fied as target schools. Additional resources, a parent 



activity leader (PAL), and a lower student-teacher 
ratio have been established to intensify efforts to 
maximize student achievement. A monitoring mecha- 
nism operates under the name ''Oversight Commit- 
tee.'' After ten years of court-ordered desegregation, 
Norfolk, in a landmark decision, won the right to re- 
turn to neighborhood schools because of its efforts to 
bring about equity in all of its schools. In the city of 
Norfolk, massive renovations have renewed the down- 
town. Now all but 12 of the city's schools are racially 
mixed. Schools that aren't racially mixed are in un- 
mixed neighborhoods. Ron Edmonds, who was con- 
sulted by the district toward the end of the study that 
led to the landmark decision to return to neighbor- 
hood schools, said that the district could return to 
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neighborhood schools and still have equity, especially 
if they continued the school improvement based on 
Effective Schools Research. He also said that Norfolk 
should have an oversight committee to monitor the 
use of resources. The Oversight Committee consists 
of business people, clergy, city council members, 
principals, teachers, and parents, for the purpose of 
monitoring equity and quality. 

Another approach to achijving quality and equity 
in a new way came through a state grant. NPS was 
awarded the three-year grant to create a model ele- 
mentary school to develop innovative approaches for 
accomplishing the system*s mission. The plan in- 
cludes specially trained teachers, a writing-to-read 
laboratory (using computers), new approaches to 
scheduling, and more. At the outset the teachers at- 
tended an intensive one-week training session just be- 
fore classes began. 

A number of other special programs to accommo- 
date the unique needs of the urban learner in the ac- 
quisition of essential skills include the Holding Power 
Plan, Project Rescue (funded by U.S. Government 
Vocational Education Entitlement), and Dropout Hot- 
line (dropout reduction and retrieval for at-risk stu- 
dents). Homework Hotline, and Writing to Read (IBM 
Grades K-1). Additional enrichment programs for 
acceleration of academic performance include 
CHROME (Cooperating Hampton Roads Organiza- 
tions for Minorities in Engineering, grades 7-12), 
NORSTAR (Norfolk Public Schools Science and 
Technology Advanced Research, grades 9-12, in con- 
junction with NASA, National Aeronautics Space 
Academy), Work-Study Plan in conjunction with Nor- 
folk Sentra Hospital, and a Magnet School for Health 
Professions (grades 10-12) in conjunction with the 
Medical Center of Hampton Roads. 



Professional and General 
Staff Development 

Commitment to becoming better is contingent upon 
relevant professional growth activities. All employees 
are involved in needs assessment, planning, imple- 
mentation, and evaluation for staff development pur- 
poses. Whether at the district, school, or individual 
employee level, professional growth activities are re- 
lated to the correlates that characterize an Effective 
School. Focus is on support for student outcomes for 
long-term benefits. Activities are meant to raise the 
levels of proficiency and increase self-confidence in 
job skills. They are intended to raise expectations of 
self and others; the needs of both the organization 
and the individual are important. 



The umbrella of the school improvement process 
gives professional development continuity and direc- 
tion. Programs focus beyond a single topic or isolated 
skill; **Dog and Pony Shows" are a thing of the past. 
Furthermore, the school improvement plan empha- 
sizes the importance of addressing the needs of ail 
employees. School improvement and staff develop- 
ment have become synonymous. 

Topics that have been covered include empower- 
ment, curriculum alignment, critical thinking across 
the curriculum, whole-language approach to commu- 
nication skills, leadership training for the school im- 
provement process, training/coaching (of central of- 
fice personnel and principals) related observing 
teacher instruction and holding feedback conferences 
on professional development, training for teachers 
coaching teachers on new concepts, skills, and strate- 
gies, middle-school teachers and teacher advisor pro- 
grams, meeting the needs of the gifted, multi-cultural 
education and international studies, literature-based 
reading instruction, and effective questioning strate- 
gies to promote higher-level thinking skills (including 
how to individualize instruction in whole-group in- 
struction by the manner in which you ask questions). 
New teachers and other new employees learn about 
improving schools based on Effective Schools Re- 
search. Ongoing training is available to virtually all 
employees. For example, by training maintenance per- 
sonnel in boiler repair, money has been saved. Work- 
shops on bathroom and floor care have been benefi- 
cial. Classified personnel have become more versatile. 

Overall, Norfolk has sent cadres to receive training 
so that they can return and train others. That way the 
district saves on the expense of sending many people 
outside the district for training, yet further reaps the 
benefits of their new knowledge by having thsm be- 
come district trainers. The beauty of this approach is 
the large extent to which the system maintains itself. 
The Training the Trainers Model has brought awards: 
the American Association of School Administrators in 
1986, and the Virginia Governors Award for Excel- 
lence in 1986. 

Because schools improve one at a time (Goodlad, 
1984), it is logical to conclude that staff members 
also improve one at a time. Consequently, the Sys- 
tem-wide Staff Development Advisory Council has 
been formed with representation from every employee 
classification, at both building and central office lev- 
els. The councirs major responsibility is to ensure 
that each member of the teaching and learning team, 
from the superintendent's level to the support staff 
levels, engages in practical, relevant, and visionary 
opportunities to grow professionally, systematically, 
and continuously. Priority is given to developing the 
leadership skills of building-level administrators, both 
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Training of 
Trainers Model 
Involvement - CommUment 




Figure 7. Training of 
Trainers Mode! 

professional and classified. The council provides 
input to the director of human relations and staff de- 
velopment, who develops the comprehensive biennial 
system-wide plan. This plan is based on State of Vir- 
ginia Standards of Quality, school board goals, 
superintendent's objectives, and results of the system- 
wide needs assessment. Major thrust is on developing 
skills and extending building-level expertise. 

The primary basis for professional development 
plans is the identification of the schools* needs by the 
Inbuilding School Improvement Team. The team in- 
terprets student performance on standardized and cri- 
terion-referenced tests. It examines attendance, disci- 
pline reports, parent and community involvement, 
accidents, perceptions of the physical environment, 
and the extent to which the eight correlates have been 
implemented. Professional development activities ad- 
dress these needs. An award-winning, cost-effective 
Training of Trainers model is the primary vehicle 
used to maintain and enhance employee skills that 
support the mission. (See Figure 7.) 

Personal Evaluation 

**Knowing that we can make a difference, and 
knowing how, we must then decide that we wiir* 
(Edmonds, 1982). What gets monitored gets done! 
**The best way to show a stick is crooked is not to 
argue about it, or spend time denouncing it, but to lay 
a straight stick alongside of it'' (Dwight Moody). It is 
upon these postulates that the personnel evaluation 
process rests as an integral component in the overall 
school improvement process. 
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PTA Membership 







+30% 
10,593 


7,604 




















*1983 




1987 



*Re5C0rds of PTA Membership not kept prior to 1983 
Figure 8. PTA Membership 

Evaluation has always existed for improving job 
skills; however, major changes in the frame of refer- 
ence, the focus on an individual employee's skills, 
and the process and procedures for evaluating staff 
was a result of the school and teacher effectiveness 
movement. The major changes are listed below: 

• Emphasis on reinforcing employee strengths to cor- 
rect weaknesses. 

• Direct observation, anecdotal notes, post-observa- 
tional conferences, and inservice replaced check- 
lists of specific characteristics and rating scales. 
Focus is on measuring outcomes and performance 
behaviors against their impact on the overall mis- 
sion. The evaluation instrument indicators of profi- 
cient performance are based on Effective Schools 
Research. 

• In evaluating administrators, particularly principals, 
instructional leadership is weighted heaviest 
among the performance behaviors. Student and 
staff outcomes are an integral part of the overall 
evaluation. 

• Peer observation, coaching, and self-evaluation are 
encouraged. 



Parent and Community Involvement 

Local universities are joining forces with NPS in 
pursuit of more Effective Schools. Partnerships have 
been established for coursework to address present 
and future needs. Tuition rates for school system em- 
ployees have been reduced. 

''Directions Toward Excellence,'' a school system 
publication, is mailed to all residents of Norfolk four 
times a year. It communicates the system's goals and 
objectives and highlights student and staff accom- 
plishments. This effective public relations tool is aug- 
mented by the NPS Channel 28 Update News broad- 
cast. 

ERLC 



The public image of the school system is changing 
as is evidenced by positive media coverage, increased 
student enrollment, numbers of volunteers, and school 
••adopters.** An increase in PTA membership over 
the past five years is another indication of the 
community's confidence in the school system (Figure 
8). 

Further evidence of positive school-conmiunity re- 
lations can be found in the support and commitment 
of community services and funding agencies. Each 
school has been adopted by one or more business or 
community agencies. The Academy for Educational 
Development, supported by the Ford Foundation and 
Carnegie Institute, sponsors the Urban Middle School 
Adolescent Pregnancy Prevention Project; The Tide- 
water Scholarship Foundation assists average college- 
bound students in completing the application process 
and securing financial resources; the Danforth Foun- 
dation provides funds for several professional devel- 
opment activities for school board members, princi- 
pals, and teachers. 

With any change, and especially one that is as far- 
reaching as the SPIRAL process, a certain number of 
problems, issues, or concerns are expected. Problems 
that have been encountered evolve around external 
mandates, changes in the community, and confusion 
over roles and responsibilities. Although these were 
few in number, they were important. Because of the 
system-wide team effort to ensure equity and quality, 
problems have been minimized. 

The first of the concerns was the short time (six 
months) that the school division had to develop and 
implement a comprehensive, system-wide school im- 
provement plan as the result of a school board man- 
date. At that time (1982) no one had knowledge of 
any school divisions in the United States where plans, 
broad in scope, were in place. A planning committee 
with a strong belief in students was appointed. Mem- 
bers of this committee were committed to the mis- 
sion, and believed that the NPS team could accom- 
plish it. At the recommendation of the late Ron 
Edmonds, a cadre was trained at the Michigan State 
University Summer Institute on Effective Schools. 
Also, members of the staff visited several school dis- 
tricts that were in the initial stages of implementing a 
school improvement program. These resources pro- 
vided the foundation for the development of the 
model (SPIRAL) Norfolk Public Schools was to im- 
plement. 

The second major issue dealt with the changes in 
the community. Many of the formerly urban poor 
neighborhoods were demolished and replaced by 
neighborhoods of middle- and upper-income families. 
Massive crosstown bussing was eliminated and neigh- 
borhood elementary schools were reestablished. As a 
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MY MISSION 

Teaching and Learning 
Equitv/Quality 
For All 



Signature 



Figure 9. Norfolk Commitment Card 



result, one-third of the schoois were comprised of 
poor and predominantly black students. The burden of 
equity and quality for all presented challenges. The 
Target Schools Program, previously mentioned, is 
providing the means by which the needs of these stu- 
dents are being met. In addition, the Multicultural Ed- 
ucation and Enhancement Program was established to 
afford students of all races, cultures, and socioeco- 
nomic classes an opportunity to interact and develop 
an appreciation of one another. 

Another concern was the closing of the secondary 
alternative school due to limited space. It had been 
established to prevent extremely high-risk students 
from dropping out of school due to very low achieve- 
ment and severe behavior problems. The teachers and 
counselors assigned to the school were involved in 
designing the new program, which v/as relocated in 
the regular high schools. Inservice sessions were con- 
ducted to prepare them for the change and support 
groups were formed among the three centers. 

The Definition of "Effective Schools" 

The major problem in applying the research of the 
Effective Schools movement has been the acceptance 
of the belief that **A11 students can learn." Great 
strides are being made to strengthen the belief system 
of both staff and students through professional growth 
activities. Instead of giving **lip service" to the no- 
tion, staff members are demonstrating behaviors that 
prove that belief, commitment, acquisition of skills 
and knowledge, determination to ** follow through," 
and willingness to pull together as a team, make the 
mission of teaching and learning attainable. Taking 
time to celebrate student and staff success is a top 
priority! In fact, staff cannot help but be reminded 
that the mission is possible, when they are adorned 
with a wallet-sized commitment card pictured above, 
a logo pin, mission statement briefcase tote, pencil, T- 



short, sun visor, coffee cup, paperweight, book- 
mark. . . . 

The interpretation of the definition of an Effective 
School has caused some to dispute the logic of the 
statement. Many interpreted it to mean that NFS ex- 
pects all students to learn the same things at the 
same rate. At every opportunity, visual examples are 
shared to help all understand that the key point of 
comparison in disaggregated data is proportionate 
rate of improvement. 

The initial perception that the Effective Schools 
movement was solely for remediation of low-achiev- 
ing students was another obstacle to overcome. SPI- 
RAL, along with the system-wide goals and objec- 
tives, as well as the goals and objectives of the 
individual schools, has virtually eliminated the prob- 
lem. All students, staff, and programs are monitored, 
supported, and reinforced. 



The Issue of Finding Time 

Last, but not least, time for building school im- 
provement teams, to evaluate progress, and to make 
future plans is limited. Therefore, this year, early dis- 
missal of students during the last week of school has 
allowed more needed time for building teams to be- 
come operational. 

No matter how many roadblocks appear, or how 
much effort and time it takes, the school improvement 
process is worth implementing because of what it 
does for the students and staff. Nothing can do more 
for making schools places for optimal teaching and 
learning, where caring and celebration are prominent, 
than a systematic plan which involves all who are to 
be affected by its implementation — ^students, staff, 
and the community (Gross and Gross, 1985). 

The folJowing advice is offered to those who are 
interested in initiating or refining a school improve- 
ment plan: 
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1. Obtain commitment and support for school im- 
provement from the school board and superin- 
tendent 

2. Address the plan as a continuous process and 
not a program; programs are often short-lived, 
^nd narrow in scope. 

3. Label budget requests according to Effective 
Schools criteria and correlates so that commit- 
ment to the Effective Schools process is evident 
and so that the most crucial needs relative to 
improvement are addressed. 

4. Require that central office school improvement 
plans support the process of school-based im- 
provement. 

5. Provide time allotted during the workday for 
school staffs to develop, assess, and acquire 
skills needed to implement school improvement 
plans. 

6. Implement a remediation component for stu- 
dents who have not previously been successful 
in the regular educational setting (alternative 
instructional approaches). 

7. Sustain the momentum of the process and 
keep the mission focused through visual re- 
minders such as buttons, pins, T-shirts, and 
cards. 

8. Align curriculum, testing, and staff development 
with needs assessments and data that reflect stu- 
dent achievement. 

9. Monitor program implementation and outcomes 
continuously. 

10. Disaggregate student data on the basis of SES 
(socioeconomic status) and gender. 

11. Schedule superintendent interviews with prin- 
cipals and their school improvement teams, as 
well as with central office departmental heads 
and key members of their staffs, to discuss 
school improvement. 

12. Develop biennial school improvement plans; 
assess and modify them annually. Goals, objec- 
tives, and strategies should be limited in number 
but high in quality, eliminating those which 
have not brought about positive results in the 
past. Correlate the plan with the system-wide 
Six-Year Improvement Plan and the regional ac- 
creditation processes (SACS — Southern Asso- 
ciation of Colleges and Schools) to unify efforts 
and to avoid creating a feeling of being over- 
whelmed when involved in the self-study/ac- 
creditation process. 
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13. Practice impatient patience; recognize that 
school improvement takes time. 

14. CELEBRATE successes! 

15. Concentrate on team-building! 

16. Make all decisions based on **what is best for 
the student!" 



Commitment to school improvement is a heavy re- 
sponsibility, but a shared responsibility. It requires a 
plan, strong support, leadership, staff development, 
and accountability. Norfolk Public Schools' process 
(SPIRAL) represents research into practice. The pres- 
ent picture is one of systematic planned progress for 
improved performance for students, teachers, adminis- 
trators, and support staff members. 

Periodic progress reports are presented to the 
school board and lo the local citizenry. Reports focus 
on student achievement, attendance, dropout rates, 
promotion/retention statistics (disaggregated data). 
Parents and community members are heavily involved 
in planning, implementing and evaluating school im- 
provement. Through the Adopt-A-School program, 
business and agencies support the goals and objec- 
tives which reinforce the belief that all students can 
learn and are entitled to equitable opportunities for a 
quality education. The school board and administra- 
tive staff demonstrate continuous support by provid- 
ing the means by which the school improvement pro- 
cess can operate. 

High instructional expectations and commitment of 
all personnel to the mission will produce desired 
pupil achievement. The school district's belief sys- 
tem — symbolized by the theme ** Believe — Achieve — 
Succeed!" — undergirds everything that the school 
system is about. The results speak for themselves! 
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Alma Public Schools 

Became involved in Effective Schools process in 1983 



Community 

Population 

10,000 

Alma, predorriinantly middle 
class, Is located in an 
agricultural area in the 
center of lower Michigan. 
The seven townships that 
make up the Alma school 
disirict are primarily 
agricultural. In Alma the four 
major industries Important to 
the economy are the Total 
Refinery (petroleum), Lobbeli 
Emory (auto-related), Alma 
Products (auto-related), and 
Alma Plastics. Alma College, 
a small liberal arts college 
with an enrollment of 1,200 
brings a number of 
professional educators to the 
community. 

Thirty-three percent of the 
public school students are 
from low-income families as 
measured by applications for 
free-and-reduced price meals. 



School District 



Enrollment 

Z710, about half live outside 
the city in an area covering 
100 square miles. 

Ethnic Composition (percent) 

Caucasian 92 
Hispanic 7 
Other 1 



Per Pupil Expenditure 

1988-1989 



$3,448 



Percent bussed 

51 



Schools 

Elementary (K-4) 
Middle schools (5-8) 
High schools (9-12) 
Alternative high school 
Adult ed. high school 

Number of Staff 

Administrators 
Certified teachers 
Support staff 



19 
150 
7 



Student-Teacher Ratio 

Elementary 
Middle 
High school 

Percent coilege-bound 
(approx.) 

NA 



25. :1 
25:: 1 
24.: 1 



Abstract 



Alma has identified ils present state and its 
goals for the future (mission, vision, beliefs, exit 
outcomes). The challenge is to get there. An In- 
dividual school improvement planning process 
is essential for accomplishing these goals. Mis- 
takes will be made along tne way, but the 
school district believes it is moving in the right 
direction ensuring that all children be ade- 
quately prepared for the future. 

A small district. Alma has proceeded to build 
upon its strengths. The board of education, su- 
perintendent, and building staffs and principals 
arr nil committed to the Effective Schools Re- 
search model for school improvement. From the 
start organizational mechanisms such as a 
teacher evaluation system and a new school 
monitoring system have been integrated with 
established procedures. The role of the District 
Coordinating Committee (DCC) is to carry on 
the discourse on school improvement and to 
initiate a district focus on school improvement. 



In spite of a good staff development program, 
Alma has not seen **remarkable instructional 
Improvement" or improved student achieve- 
ment test scores overall, but is moving in that 
direction. In addition, data were not disaggre- 
gated until the second year. Perhaps too much 
emphasis was placed on staff devekDpment for 
teacher effectiveness before these information 
feed-back mechanisms were in place. Never- 
theless, these components to the process are 
now in place, and increased achievement for 
ail children should occur. Because the district 
has very good achievement levels for grades 2- 
8 (in the sixtieth to sixty-fifth percentile on aver- 
age) their effort is commendable. Many districts 
with this level of average student achievement 
might not expect to improve significantly and 
would not entertain **school improvement." 
Alma, however, knows that many of its students 
ai0 not performing to their potentkal and are 
fully Implementing the Effective Schools process 
for purposes of equity in their program. 
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Alma Public Schools 

Alma, a small, rural community in the center of 
lower Michigan, with a population of 10,000, is the 
home of Alma College, a private 4-year liberal arts 
college of 1,200 students. About one-half of the 2,710 
K-12 students live outside the city in an area cover- 
ing 100 square miles. The ethnic composition of the 
students in the school district is 92 percent white, 7 
percent Hispanic, and the remainder American Indian, 
Asian, and black. Thirty-three percent come from 
low-income families as measured by the number of 
student applications for free-and-reduced price meals. 
The total general fund expenditures per pupil are 
$3,448, about the same as the state average of ap- 
proximately $3,560 per pupil. 

In the Alma school district there are three small 
private schools: St. Mary's (80 students), Grace Lu- 
theran (19 students), and Seventh Day Adventist (7 
students). Alma has one high school (757 students), 
one middle school (772 students), three elementaries 
(1,181 students), an alternative high school (80 PTE 
students), an adult high school (61 PTE students), and 
an adult basic education program (40 PTE students). 

Why Did Alma Launch the Program? 

The superintendent and the assistant superintendent 
were aware of Effective Schools Research, and in 
particular, some of the eariy published reports by 
Ronald Edmonds and others. In the summer of 1983, 
the Institute on Effective Schools Research was of- 
fered at Michigan State University, and the superin- 
tendent and assistant superintendent attended. Effec- 
tive Schools Research appeals to Alma because it 
attempts to identify the positive characteristics of ex- 
emplary schools, especially those associated with op- 
tional student performance. The research provides the 
value system and tools to establish schools where all 
children can learn. 

Following the summer institute, the district investi- 
gated further the research on Effective Schools by 
visiting Dr. Lawrence W. Lezotte at Michigan State 
University to get guidance as well as to help in locat- 
ing research abstracts. In the fall of 1983, at the urg- 
ing of central office administrators, the Alma Board 
of Education created a 25-person "Effective Schools 
Task Force** to review the literature and research on 
Effective Schools and to make judgments about the 
applicability of that research to school improvement 
planning. That task force, made up of principals, 
teachers, parents, and non-parent representatives, re- 
viewed the literature and research on "teacher" and 
"school** effects that correlated with student achieve- 



ment. They proposed the following definition of an 
Effective School and selected the following seven 
characteristics as being the ones they would most like 
to see in the Alma school district: 

1. A clear and focused school mission. There is a 
clearly articulated mission of the school through 
which the staff shares an understanding of and 
commitment to instructional goals and objec- 
tives, priorities, assessment procedures, and ac- 
countability. 

2. Instructional leadership. The principle acts as 
the instructional leader, supported by the build- 
ing staff, and together they effectively commu- 
nicate the mission of the school to the commu- 
nity, parents, and students. The principal 
understands and applies the characteristics of in- 
structional effectiveness in the management of 
the instructional program, including well- 
planned and systematic staff development pro- 
grams. 

3. Teacher effectiveness. Classroom instructional 
leadership reflects enthusiasm, resourcefulness, 
knowledge of the subject matter, and the ability 
to relate to students. An effective teacher stimu- 
lates interest by utilizing a variety of techniques 
which provide for individual differences and 
learning caf)abilities. 

4. High expectations. There is a climate of expec- 
tation in w^-xh the staff believes and demon- 
strates that all students can attain mastery of 
basic skills and where students are encouraged 
to attain their highest potential. 

5. Frequent monitoring and evaluation of student 
progress. Student academic progress is mea- 
sured frequently. Multiple assessment methods 
are used. The results of assessment testing are 
used to improve individual student performance 
and the instructional program. 

6. A safe and orderly environment. There is an or- 
derly, purposeful, and cooperative atmosphere. 
The climate is conducive to teaching and learn- 
ing. Discipline policies are clear, firm, and con- 
sistently enforced. 

7. Good home/school relations. Parents are given 
the opportunity to understand and support the 
basic mission of the school. Schools actively en- 
courage positive and constructive relationships 
between the school and the community. 

Instructional leadership inservice was provided for 
all building administrators on a regular basis. The dis- 
trict testing policies and practices were revised. All 
performance objectives (K-12) were reviewed and up- 
dated. All district newsletters began to contain infor- 
mation on the Effective Schools process, and Effec- 



5.3 



54 



Case Studies in Effective Schools Research 



Prioritios 

The board of education goals for 1983-84 included: 

• the development of individual schpoi improvement plans 

• consideradon of board policieis specifically dealing with school improvement 

• formation of a district coordinating committee (DCC) to carry on the discourse on 
school improvement 

• a monitoring process for the school improvement plans 

• board direction to focus on the needs of at-risk and disadvantaged students 



The board adopted a mission statement and endorsed a rationale and assumptions: 



Mission Statement 

The Alma School District believes that all students, regardless of family background, socioeco- 
nomic level, or sex, will achieve mastery of the essential objectives in each subject area or 
course. Each student is encouraged to achieve to his/her highest potential 

Rationale and Assumptions 

1. It is essential that a public Institution clearly define itself; i.e., what it believes^ln and 
stands for* 

2. All schools should be held responsible for effectively teaching basic skills to all students. 

3. The school building is the key unit for change. 

4. Focus must be on the organization of the individual school to bring about desired 
change and improvements. 

5. Local school organizations with adequate assistance can create conditions required 
for change and improvements. 

6. School improvement can l>e planned and managed. Meaningful change occurs 
through a systematic process, not as an event. 

7. Large amounts of money to initiate and sustain educational innovations are not essential. 

8. Local improvement efforts produce desired changes in pupil performance, 

9. Continuous personal partlcipatfon by the implementing staff is needed to firmly root 
and sustain the change. 

10. Administrators play a crucial role in supporting the utilization process of a new method 
or idea. 

11. The main focus of school improvement is instructional effectiveness and school 
effectiveness. 

12. The improvement of schools is a task requiring community commitment. It cannot be 
left solely to the schools. 

13. Constructive change is encouraged through a process calling for an objective assess- 
ment of school programs followed by articulated building improvement plans. 

14. All staff members must believe that all students can learn. 
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live Schools Research abstracts were purchased and 
placed in every building. The administration encour- 
aged principals to make instructional effectiveness a 
topic in faculty meetings. Finally, the school system 
hired school improvement and testing consultants to 
help with the initial efforts. 

Finances 

Because the Alma school district already had a 
commitment to professional development for all staff 
members, school improvement efforts in these early 
years did not require large amounts of money. In 
1985-86 the individual school improvement plans 
cost $25,000 and this year, 1988-89, the cost is 
$33,100 or 0.3 percent (.003) of the budget. 

Individual school improvement plans and their cost 
have become part of the budget-planning process in 
the spring of each year. All funding has come from 
the genera] fund. Each building has a line item for 
school improvement to cover the cost of implementa- 
tion, as well as a separate line item for professional 
development, created for each principal's use in the 
building. In addition, significant district-wide commit- 
ments were made for professional development activi- 
ties related to school improvement. For example, the 
board adopted a three-year budget for voluntary 
teacher effectiveness training. At the end of two 
years, 90 percent of teachers and 100 percent of dis- 
trict administrators had completed the 30 hours of 
"ITIP" (Instructional Theory into Practice) training 
and many of them were taking advanced training. The 
number of days per year devoted to professional de- 
velopment has risen from 1.6 days per year in 1983- 
84 to 5.6 days per year in 1987-88. The district has 
allocated for 1988-89 a budget of $168,105 or 1.7 
percent of the budget for staff development. 

Program Implementation and 
Evaluation: Monitoring 

The district found out that programs can be reor- 
ganized to meet the needs of a diverse body of stu- 
dents. Large amounts of additional money were not 
required, instead the district placed much stronger re- 
liance on research and data. Individual school im- 
provement plans, based on assessment data and stu- 
dent achievement data, brought requests for program 
improvements such as: Math Their Way, DIP (Dis- 
covery in Phonics), QUEST, and Writing Across the 
Curriculum Program, to mention a few. 

Greater emphasis was recently placed on closer 
monitoring of instructional programs and school im- 
provement plans to make sure they actually benefit all 
students and bring about positive change. The district 



began to monitor and adjust programs rather than im- 
plement programs and then forget about them. By 
paying more attention to the test data from the Michi- 
gan Education Assessment Program (MEAP) and the 
California Achievement Test, Alma public schools 
personnel are better able to improve individual stu- 
dent performance as well as the delivery of instruc- 
tional programs. 

Even though the district had written performance 
objectives in 1975 for each subject and each grade 
level, and these are updated regularly, one need that 
surfaced was realigning the written, taught, and tested 
curriculum. Teachers and administrators needed to 
clarify what to teach and what students needed to 
learn, and then how to test for achievement. The dis- 
trict is presently working to realign the math, reading, 
and science curriculum with student performance ob- 
jectives of the State of Michigan and with textbook 
objectives. Alma has also developed competency 
exams in the areas of writing, language arts, and 
mathematics at the secondary level. A science compe- 
tency exam will be ready in 1989. In developing cri- 
terion-referenced tests. Alma is using technology and 
software available (TestMate, item banks, etc.) to 
make the process efficient. 

Disaggregated Data 

Since Alma is now disaggregating data on a dis- 
trict-wide and building-level basis, the staff can look 
at achievement scores (state, local, and CAT) to de- 
termine whether all students are mastering the 
basic/essential skills and knowledge and whether 
there are differences in learning among the subgroups 
of the student population (boy/girl, blacky'white/Hispa- 
nic, middle income/low income). The individual 
school improvement planning process will help in de- 
veloping plans and programs to address deficiencies 
shown in the data. 

Norm-referenced Assessments 

California Achievement Tests (total battery group 
scores— national percentile) in elementary grades 2, 3, 
and 4, indicate a significant and consistent improve- 
ment, as shown in Table 1. Group aptitude scores are 
consistently at the 55 percentile with a variance of 
plus or minus 3 percent. California Achievement 
Tests (total battery) in grades 5-8 have not indicated 
significant gains and maintain achievement levels in 
the 60-^5 percentile. Table 2 shows the MEAP Math 
test results, 1984-1988, at grades 4, 7, and 10. All 
have improved, with significant numbers moving into 
the fourth quartile. 
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Local Writing Scores 

All students in grades 3, 6, and 9 also complete a 
holistically scored writing assessment. Competency 
has been increasing slowly but steadily since its intro- 
duction in 1984. In 1986-87, twenty (10 percent of 
the grade 9 students) failed the writing test. Through 
use of a peer tutoring program all but two students 
have reached competency prior to grade 11, 

More Documented Changes 

The Connecticut School Effectiveness Question- 
naire was administered in 1985 and 1987 by all six 
schools. Each of the three elementary schools has 
demonstrated significant increases in their scores. The 
combined scores for the schools indicate an approxi- 
mate 10 percent increase for each correlate, averaging 
the following for 1987: 



School and community relations 67 

High expectations 69 
Opportunity for learning/time on task 82 

Safe and orderly environment 85 

Instructional leadership 85 

Frequent monitoring 87 

Clear mission 92 



The middle school and high school showed rela- 
tively little change. 

Specific Areas of improvement 

Each school has identified specific areas of need 
from the correlate results which have been addressed 
in school improvement plans producing excellent re- 
sults. These specific improvements may not always 
improve the overall assessment. 

Program Innplementation and Evaluation: 
Evaluation of Staff 

The board-approved teacher performance criteria 
and evaluation instruments were not changed. Also, 
correlate assessment data and teacher effectiveness 
training were not used as a tool in formal evaluations. 
Administrators did no^ want the teachers* union or in- 
dividual teachers to see teacher effectiveness (ITIP) 
training or the use of data as threatening. Because of 
this approach, over 90 percent of the teachers com- 
pleted the 30-hour ITIP training in the first two years 
of the three-year program. Advanced training work- 
shops have been instituted, as have peer coaching, 
scripting, and the development of a common language 
for improving teaching. All are now well accepted by 
teachers. 



Furthermore, the building principal's job descrip- 
tion now ties in closely to the characteristics of Effec- 
tive Schools. For example, the principal is responsible 
for assuming a major role in the development of a 
safe and orderly environment. Principals are to de- 
velop and clearly articulate the mission of the school. 
They are to provide instructional leadership and a cli- 
mate of high expectations. They chair building school 
improvement teams, assume major responsibility for 
planning and operationalizing the student testing pro- 
cedures, and involve staff members in decision-mak- 
ing. The board also adopted several school improve- 
ment policies concerning staff involvement in 
decision-making, professional staff development op- 
portunities, professional travel, and conference atten- 
dance. 

Alma's policies now clearly spell out the board's 
commitment to an individual school improvement 
planning process. The superintendent is responsible 
for implementing an annual school improvement plan- 
ning process, making reports to the board of educa- 
tion on the progress of each school's improvement 
plans, and making recommendations for future plans. 
Evaluation of staff on a formative basis is an ongoing 
systematic process which generally results in im- 
proved teaching and classroom management tech- 
niques on the part of most teachers. 

Staff Development Programs 
Have Been Modified 

In the past. Alma has participated in many excel- 
lent staff development programs through the Interme- 
diate School District (county level). Professional De- 
velopment Consortium, the Michigan Institute for 
Educational Management Network, and district-initi- 
ated efforts. However, these programs are generally 
designed to appeal to a varied audience and were not 
particularly focused on a goal or a theme for any one 
year. Alma is now focusing efforts on a five-year pro- 
fessional development plan for the district. 

The Effective Schools thrust caused Alma to look 
strongly at instructional effectiveness because that 
was one of the characteristics they wanted to see in 
the district. Besides the three-year ITIP training pro- 
gram (12 district-run workshops to date) Alma spon- 
sored clinical supervision programs for administrators 
and interested teachers. In addition, the central admin- 
istration secured strong board support for professional 
development activities in the face of severe financial 
problems (school closings, wage freeze, layoffs, and 
budget cuts). The board's commitment to school im- 
provement and professional development is a critical 
component of school improvement that has remained 
strong. 
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Program Implementation and 
Evaluation: Recognition of the 
School instructional Process 

When the district made the commitment to be 
goal-directed, research-based, and data-driven, it was 
necessary to take a closer look at the instructional 
process. One of the characteristics the Alma Effective 
Schools Task Force sought was **teacher effective- 
ness.*' The Alma District Coordinating Committee in- 
stituted a three-year ITIP training program on a vol- 
untary basis. In addition to the ITIP training, the 
district began to disaggregate the student achievement 
data by building and started addressing the equity is- 
sues in our district. 

Alma Public Schools has no data that show re- 
markable instructional improvement, but the system 
has identified the discrepancies and plans are being 
implemented to correct the problems. Staff has devel- 
oped a district mission statement, a district slogan 
(Believing in Achieving), revised the testing program 
for students, initiated cooperative learning inservice 
activities, updated student performance objectives for 



Table 1 

California Achievement Tests, 
Grades 2, 3, 4. 





1984 


1985 


1986 


1987* 


1988* 


Grade 2 


60 


58 


59 


62 (76) 


66 (80) 


Grade 3 


61 


64 


66 


68 (80) 


73 (86) 


Qrade 4 


64 


64 


64 


65 (76) 


74 (85) 



*New edition (1985) of test» which was much more dlffi- 
cuft— -scordft in parentheses are compaHsons to the 1980 
edition, . . 



Table 2 

Crfterion-referericedl Assessments 

The Michigan Educational Assessment Pro- 
gram (MEAF^ results show notable improve- 
ment for students in the fourth quartile form 
1984 to 1988. 

MEAP Math Tests, Fourth Quartile. 



1984 1985 1986 1987 1988 

Grade 4 . 80,3 85.2 88.0 9S.3* 94. 1 

Grade 7 79.1 77.5 74,3 75,0 85.5 

Grade 10 64.4 69.9 75,7 76.3 75.9 



^wo of thre# elementary achoda scored 100%. 



all grade levels, and revised courses across the dis- 
trict. This year, administrators ana teachers developed 
desired student exit behaviors and a common belief 
system as part of their involvement in an Outcomes- 
Driven Developmental Model for school improve- 
ment. The Effective Schools process focuses more at- 
tention on the instructional processes within the 
school district and classroom. 

The district also recently received a grant from the 
Michigan Department of Education to work on **alter- 
natives within special education." The grant will 
allow the development of new leaching/learning units 
in grades 2-6 in math. All special education students 
will receive math instruction in regular classes, not 
through pull-out programs. This is in keeping with 
our belief that all students will obtain mastery of es- 
sential skills. 

Because of Alma's long-term involvement in the 
Effective Schools process, administrators and staff are 
developing a common belief system to encourage 
common understanding and philosophy about teaching 
and learning. This solidifies staff commitment to the 
mission. 

In addition, Alma is establishing a common vision 
for students about what they should accomplish by 
the end of the 12ih grade (after thirteen plus years in 
the Alma system). A common set of student exit be- 
haviors (outcomes) might include (see pgs. 60 and 
61): 

• mastery of basic skills 

• concern for others 

• self-esteem as a person 

• self-directed learner 

• process skills: problem solving, account- 
ability, communication, decision-making. 



Program Implementation and Evaluation: 
The District-Level Coordinating Team 

The district established the District Coordinating 
Committee (DCC) made up of at least two teachers 
and the principal from each building (three elementar- 
ies, one middle school, one high school, one alterna- 
tive high school, and one adult high school comple- 
tion program). The DCC's main function is to carry 
on the school improvement efforts on a district-wide 
basis, and to communicate with the school improve- 
ment teams to advance coordination of the improve- 
ment program. The superintendent, central office ad- 
ministrators, building administrators, teachers, and 
board of education have been deeply involved in the 
school improvement process. However, Alma has had 
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only limited involvement of parents and student 
groups in the process. 

Each building has a school improvement team and 
that team is chaired by the building principal. In some 
of the elementary schools, the entire staff sits on the 
building school improvement team. In the larger 
buildings, ten to twelve staff members represent the 
others on the school improvement team. Parent and 
student representation is allowed, but is virtually non- 
existent. 

Since board policy and practice call for a system- 
atic school improvement planning process, each build- 
ing staff develops school improvement plans. Clear 
targets and deadlines are set following the assessment 
of needs, strengths, and resources available. To be 
funded, school improvement activities have to focus 
on the enhancement of instructional effectiveness, Ef- 
fective Schools correlate data, and improved student 
achievement. Desired student outcomes must be iden- 
tified and prioritized, and staff members must play a 
key role in deter.-nining the direction of their schooFs 
improvement efforts. Before plans can be submitted 
for funding, the whole team must reach consensus 
and sign the plan. The plan is then reviewed by cen- 
tral ofHce. 

In the first three years, 1984-1987, schools devel- 
oped annual school improvement plans. In 1987 Alma 
adopted a more practical approach by adopting three- 
year, long-range plans that are revised annually. 

Procedure!! for Success 

It would be a problem if the school improvement 
plans had a thrust in one direction while the board of 
education wanted the administration and staff to fol- 
low through on activities in another direction. Begin- 
ning with the 1983-84 school year the board *s goals 
have coordinated well with the overall school im- 
provement efforts on a district basis. Planning is now 
even more coherent overall. 

It was important that the general fund budget in- 
corporate monies to support school improvement 
planning efforts. Alma^s school improvement plans 
arc due in the superintendent's office in early spring 
for coordinating budget planning and central district 
needs with the financial needs for school improve- 
ment. 

The Effective Schools process has affected com- 
munity attitudes in a positive way. Home-school rela- 
tionships arc improving. In the community Alma pub- 
licizes the district goals and mission statement, 
student achievement gains, school improvement plans, 
and progress reports. District goals are published and 
progress is reported back to the board on a routine 
basis. 

O 

ERIC 



In March of 1988, Alma schools sought 2.5 addi- 
tional operating mills. The campaign theme dealt with 
school improvement and the need to maintain good 
quality schools for Alma's young people. Many com- 
munity groups gave positive feedback. The millage 
passed by a rate proportion of almost 3-1. The com- 
munity seems to know that the AJma schools are 
good and are willing to support them. 

The Alma district has received no additional funds 
from any service or funding agency because of its in- 
volvement in the Effective Schools process. However, 
the 1987 North Central Accreditation report praised 
Alma for its work because of its positive impact on 
school climate and student achievement. In addition, 
Alma High School was recognized as one of the top 
ten high schools in the State of Michigan by the 
United States Department of Education Secondary 
School Recognition Program in 1987. A great deal of 
credit for this award goes to the school improvement 
efforts implemented by the Alma High School staff 
and administration. 

When the board of education approves the school 
improvement plans in late spring, the board is aware 
of the financial constraints and the effect on the bud- 
get of items that they might consider. Because Alma 
is in a tight financial situation, parts of school im- 
provement plans have at times been denied. On the 
whole, large amounts of money to initiate and sustain 
school improvement innovations have not been essen- 
tial in Alma. 

During this entire process, Alma has attempted to 
deal with the administrators up-front and prior to 
dealing with other employee groups. The building ad- 
ministrator, who is expected to be the team leader on 
the front line, has been kept well informed of what is 
going on and what is coming along. For example, in 
looking at lest data and correlate assessment data, a 
testing consultant spends time with the administrators 
before the school improvement teams and other staff 
members see the data. This has been helpful and has 
kept administrators supportive of the process. 

Individual school improvement plans have helped 
the administration to focus on school problems at the 
level closest to the students being most affected. 
However, Alma has experienced some problems be- 
cause the six buildings sometimes go in different di- 
rections. At times they compete rather than collabo- 
rate. For example, when one building began a 
breakfast program for those students who came to 
school without breakfast, the other schools immedi- 
ately wanted a similar program even though their 
plans had not called for such a program. The adminis- 
tration is encouraging cooperation. The uniqueness of 
individual school improvement planning needs to be 
!wlanced with district coordination of school improve- 

B3 
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ment activities. This is the job of the district coordi- 
nating committee. The mission, vision, common be- 
liefs, district goals, and desired student outcomes 
should provide that common sense of directiony ex- 
pectations, and outcomes. How these things are to be 
accomplished should be decided at the building level 
by teachers and their principal working together. 

What Problems, Issues, or Concerns 
Did Your Program Encounter and 
How Were They Overcome? 

External Mandates 

External mandates have not caused any serious 
problems, but they can be a nuisance. For example, 
the Michigan State Board of Education's incentive 
monies are tied to increased graduation requirements. 
Although Alma students are exceeding the require- 
ments set by the State of Michigan, the board for- 
mally increased graduation requirements so the dis- 
trict could qualify for the student incentive grant. 

Community Changes 

The 3 to 1 vote that passed a recent millage in- 
crease was heartening. The increased achievement by 
students as a result of the school system's school im- 
provement efforts have been effectively communi- 
cated. The diverse programs Alma offers — special ed- 
ucation, vocational education, adult education, gifted 
and talented programs, advanced placem.ent classes, 
college classes, and programs for at-risk youngstv 's — 
meet community needs. 

Despite Alma school system successes, further im- 
provements are needed. Some students are below their 
grade level, too many high school students exit with 
low grades, and poorer students generally achieve at 
lower levels than their wealthier classmates. The 
"reading** and **science'' curriculum (K~12) are also 
being realigned because of recent research findings. 
Alma must find ways for all students to be successful 
learners. 

Budget Cuts 

Alma has maintained school improvement efforts 
despite serious financial problems. From 1972 to 
1985 enrollment dropped by 1,200 students. Four 
schools have been closed. In 1983 Alma had a wage 
freeze. In 1988 the public voted for 2.5 additional op- 
erating mills to keep the system from developing a 
deficit. Alma is working to establish a sound financial 
base for long-term school improvement and staff de- 
velopment. 



Format for School Improvement Plans 

School improvement teams now write plans using 
a specific format and criteria. Not only are plans eas- 
ier to read, but they are also more apt to better meet 
actual needs. For example, the plans must describe 
the focus of change, expected change in student be- 
havior, implementation procedures, how success will 
be assessed, and what resources will be needed. Plans 
will also be needed for implementation, then the 
building team will have to explain the results of their 
efforts. 

Parental Involvement 

The early Effective Schools task force involved 
parents, but getting parents to stay on the committees 
has been difficult. Parents appeared to be interested, 
but were not willing to commit so much time to the 
process. Alma will continue its efforts to involve par- 
ents in the process. 

Technical Assistance 

Alma hired several part-time consultants fcr assis- 
tance. Consultants have played a vital role in the fol- 
lowing areas: school improvement planning, testing 
and the evaluation of data, group processes, writing, 
computer technology, outcome based education, ITIP 
training, cooperative learning, assertive discipline 
training, fitness, and health. 

Unions 

The Alma district has a good working relationship 
with its two major unions, the Alma Education Asso- 
ciation (Michigan Education Association) and the 
OCAWIU that represents support staff (cooks, bus 
drivers, custodians, and maintenance personnel). 
Grievances and concerns are minimal, but when they 
do occur, both parties meet and discuss the situation 
with a spirit of cooperation. Contract problems are 
corrected during the school year and not put off until 
bargaining. Staff input in planning and decision-mak- 
ing keeps these relationships healthy. 

Strategic Plan 

Alma will develop a strategic plan for looking at 
the entire school organization and its efforts to bring 
about improved student achievement and desirable 
student exit behaviors. By matching knowledge (re- 
search, experience, data) with goals (desired student 
exit behaviors and teacher behaviors, philosophy, be- 
lief system, commitment, and mission), AJma can as- 
sess what it actually docs (classroom practices, curric- 
ulum planning, leadership behaviors, research and 
data driven). As AJma achieves a better match, stu- 
dent achievement should be enhanced. 
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ALMA PUBLIC SCHOOLS , 
DESIRED STUDENT EXIT BEHAVIORS* 



Behavior 


General Attributes 


Sample Measures 


1. Self-esteem as 


A positive vision of the 


Exemplifies knowledge of self 


a ieamer and 


future 


Displays adequate self concept 


a person 


Works well with people 


Wfiling to take nsks 




Personal Integrity 


Good time manager 




Views self as successful 


Displays an attitude supportive of inquiry 




learner 


Knows what he/she wants in life and 




Good self concept 


learning 




Search for the truth 


Builds overall wellness into life 




Feels lovable and capable 


Has a clear value system— acts on 






values 






Excels at something 


IL Cognitive Learning 


Able to function at all cog- 


Good grades in school 




nitive levels — krK)wledge, 


Competency exams 




comprehension, imple- 


Academic excellence attained— GP A 




mentation, analysis, 


Kinds and number of courses taken 




synthesis and evaluation 


Works up to full potential 




Mastery of basic skills- 


Demonstrates cognitive learning — low 




math, reading, science, 


and high 




social studies, health, 


Bilingual 




vocational skills, lan- 


Presidential Academic Fitness 




guage arts, writing, 


Norm-referenced achievement stats— 




computer luerocy 


ou% or oetter 




Communicates thoughts 


Emptoyabiiity skills test 




clearly 


Employed 




Parenting skills 






Extended learning— full 






intellectual development 






Career education 






Fine Arts appreciated 






Knows a foreign language 




III, Process Skills 


Problem solving skills 


Demonstrates: 




Critical thinking skills 


Good interpersonal relationships 




Dedsion-making skills 


Attendance records 




Voting forecasting 


Takes leadership roles 




Goal planning 


Completes tasks started in a timely 




Accountable 


manner 




Communication skills 


Speaks and writes clearly and concisely 




Group process skills 


Takes an active part in political process 




Team work 


Gets people to work together 




How to adapt to change 


Sports: Participation as a team member 



Extra curricular activities 



This Wr an instrument for discussion to help clarify exH outcomoB. The attrtoutes and measures are samples and are not 
meant to be all Inclusive. 
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Behavior 


General Attributes 


Sample Measures 


IV. Self-directed 


Knows how to learn 


Use of library 


Learner 


Study skills and research 


Makes good use of leisure time 




Has a good setf-concept 


Comparison shopper 




Inquiring mind 


Given an idea, he/she can develoo it 




Intellectual Iv curious 


• fdsedrch oDtions decide and 




Reads for pleasure and 


imofement 




information 


Completes homework 




Can elaborate upon original 


Creative Droblem-isolvinQ activitip<> 




ideas 


Exam Die: Odvssev of the Mind 




Takes responsibility for pre- 


Quiz Bowl 




paring 


Debate/Forensics 




Goes the extra mile 






Seeks help when needed 






Goes beyond the minimum 






asked 






Is creative, flexible, has original 






ideas 




V, Concern for 


Tolerant of options and values 


Observe behavior 


Others 


of others 


Participates in volunteer efforts to help 




Compromise 


handicapped, elderly and poor 




Tolerance 


Demonstrates social courtesies 




Patience/accepting 


Respectful of all others 




Caring 






Develops a global awareness 






Enculturation 






Sensitive to those who need help 




A good citizen 






Thoughtful 






Involved with volunteer 






projects, community serv^ice 




Shows respect for others 




VL Emotional, social 


Physical fitness 


Health test 


and physical well 


Emotional stability 


Successful completion of physical 


being 


Aware of health issues 


education courses 




(drug and alcohol abuse) 


Drug free 




Manage stress 


Builds overall wellness into life 






Fitness 






Michigan Model Health 






Fitness measures 






Quest 






BuikJs healthy relationships 






Demonstrates interpersonal skills 
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ALMA PUBLIC SCHOOLS 

WE.:WLIEVE:-=;.:r;- 

I. We believe that ail stuctents can learr^^ time and appropriate 

■ suppiort.;. ;■ • ■ ■ 

2.. We beiieye that schools control enough of the variables to influence student 
success. The task of schools is to after the learning environment to provide 

■ corwlitions for success; ■ 

3. :We believe that the manner W^W^^^^ have direct 
and Impprtant bearing on success for that ^dividual 

4. We t)e!ieve that one of the most ^ghiificam^ is to intentionally enhance 
the student* s view of himself as a learner and as a worthwhile person. 

5. We believe that ai: students can be expected to success^lty acquire what we 
identify as essential learning Outcomes. The rate at which students will ac- 
quire th«%se skills will vary, but the expectations for their success will not 

6. We believe that all students have unique skills and tatents. Our task is to 
identify these skills and talents and then nurture their development. 

7. AfVe believe that learning wlH be mwe successful when the experiences have 
meaning for the studerit 

8. We believe that all students can acquire skills and understarujings at higher 
cognftive levels. We commit to keep (^portunities open on each learning 
task, ■ , ■ 

9. We believe that the role of all school personnel is to act in the best interest 
of the students. We will systematically build and maintain positive relation- 

'■ 'shipsc:: 

10. We believe that a student's rate of learning rti ay vary from task to task» We 
are committed to keep opportunity open and provide support until essential 
. learning is in place. 

II. We believe, that all of our professional behavtors need to be intentionally 
aligned with the most applicable knowledge, regarding learning and individual 
behavior* 

12< We believe that how fast a student learns does not determine the success of 
that leamer. We believe that the essential requiriament is that a student learn 
and be successful/ The rate at which a student learns does not diminish the 
power of that learning. 

13. We t>elieve that learning is an open experience. There are no mysteries or 
surprises in the total process. What is to be learned, how It is to be learned, 
:ir:d how It will t)e assessed will be clear and open at all times. 

14. We believe that any grouping which places students in situations where learn- 
ing expectations and opportunities are automatically limited is not acceptable. 

15. Educational achievement and opportunity require the responsible commitment 
and participation of the Board, community, students, parents, and entire staff. 
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Anoka-Hennepin 

Became involved in Effective Schools process in 1984 



Community 

Population 

129,000 

Northern suburban area of 
Minneapolis (mostly residential, 
some agricultural areas); all of 
three municipalities and portions 
of ten; predominantly middle 
class. Most residents work in the 
Twin Cities area in education, 
government, industries, and 
business. Within the school 
district major industries Include 
Federal Cartroge, Hoffman 
Engineering, and John Roberts 
Printing. A number of smaller 
industries and businesses round 
out the economy. The percent 
of children from lower 
socioeconomic levels in the 
various schools ranges from 4 to 
16.6. 

(K-12) 8.76 percent on 
free-and reduced lunch. 



School District 



Enrollm#nt 

32,190 (second or third largest 
In state, alternates with St. 
Paul), 

Ethnic Composition (p#rc#nt) 

African-American 6 
Native American 1.0 
Caucasian 95.0 
Hispanic .8 



P^r Pupil Exp^ndituro 

1988-1989 $4,253 



Ar^a (in square mllos) 

172 



Schools 

Elementary schools 
Middle schools 
Junior high schools 
High school 
Post high school, 
voc-tech 



27 
1 

5 
3 

1 



Student-Staff Ratio: 
Does not include special 
ed., paras & adm.; includes 
all other certified staff 
and reg. ed. paras. 

Percent bussed 

77 



Number ot Staff 

BIdg. Administrators 55 
District Administrators 55 
Certified teachers 1,800 
Support staff 1 ,050 

Does not include substitutes, 

community education, or 

post-secondary 

Student-T^ach^r Ratio 

Elementary 27:1 

Middle/Junior high N/A 

High school N/A 

Elementary 22:1 

Junior High 18.6:1 

High school 21.6:1 

P^rc^nt collega-bound 
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Abstract 



"A good school district that wanted to get 
befler," Anoko-Hennepin used the Effective 
Schools process to promote consistency across 
schools in Its educational program. Many excel- 
lent educational programs and practices al- 
ready existed in the district, but there was a 
tack of focLS and many discrepancies within 
schools and among schools in the implementa- 
tion of these programs. The Anoka-Hennepin 
district leadership was not certain that they 
were serving oil children well. Also district per- 
sonnel believed they had to be more account- 
able to their communities and families of stu- 
dents. So they gathered data and used them in 
a systematic way to inform their constituencies 



as well as principals and teachers about how 
well all students were achieving. 

An excellent description of the change in 
beliefs and the mind-set of school personnel 
over the course of the Effective Schools process 
is found under "Advice for other schools?" 
(page 70). The importance of training for team 
building and participative management skills is 
also described. A plea is made to include cur- 
riculum consultants in the same training pro- 
grams as teaching staff and principals receive, 
to make the process of integrating curricular 
and slaff development with the school improve- 
ment program more efficient. 
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Brief Overview of the 
Effective Schools Program 

Anoka-Hennepin Independent School District No. 
11 is a suburban scliool district north of Minneapolis, 
Minnesota. The district covers 172 square miles and 
enrolls 32,190 students in its regular K-12 education 
programs. With the opening of Andover Elementary 
in the fall of 1988, the district has 27 elementary 
schools, one middle school, five junior highs, three 
senior highs, and one Area Technical Institute for 
post high school students. Other important demo- 
graphic information includes: 

• About 5.9 percent (1,830) of the district's school- 
age children attend non-public schools in the dis- 
trict. 

• Sixty-five percent of the dwellings in the school 
district have school-age children or younger. 

• Student enrollment is increasing slightly. 

• Another 589 youngsters attended preschool handi- 
capped programs in the district in 1987-88. 

• The Anoka-Hennepin School District is the second 
largest in student enrollment in Minnesota. 

• The district's three (grades 10-12) high schools 
rank first, second, and fourth largest in Minnesota. 

What motivations launched the program? Emerging 
research and literature suggested that in even the best 
school districts certain educational practices work bet- 
ter than others, and for a district to be truly effective 
it must discard practices judged to be ineffective. Ini- 
tiating a school improvement process was, in part, a 
response to some of the recent criticism of public 
schools in this country by major reports, study com- 
missions, and critics. The district recognized the legit- 
imacy of some concerns and wanted to respond in a 
forthright manner where needed. The district also rec- 
ognized pressure for more public accountability and 
saw in this process a vehicle for responding to this 
concern. Perhaps most important, the district saw the 
Effective Schools program as a process for coordinat- 
ing the variety of excellent educational practices cur- 
rently existing in the district under a common plan, 
guided by a stated mission: **Every Anoka-Hennepin 
Student Will Learn.'' 

Emergence of Interest 

As practical ideas emerged from Effective Schools 
Research, the district superintendent, administrators, 
and curriculum consultants began to show an interest 
in the process. On Superintendent Finch's initiative, 
an educational consultant group was brought to the 
district in 1983 so that district administrators could 
look at the research and consider whether the educa- 



tional programs and students could benefit from the 
process. 

In March 1984, four district staff members at- 
tended an Effective Schools Institute in Scottsdale, 
Arizona, hosted by the Glendale Union High School 
District with Dr. Lawrence Lezotte, Michigan State 
University, and Dr. Mac Bernd, Glendale, serving as 
conference leaders. The four who attended included 
the elementary curriculum coordinator, an elementary 
principal, and district science and reading consultants. 
On their return, they expressed enthusiasm and sup- 
port for the Effective Schools process. During April 
they reported their reaction to various groups within 
the district, including the Instructional Management 
Team, the school board, the Staff Development Com- 
mittee, and elementary and secondary principals. 

On June 15, 1984, Dr. Lezotte was brought to the 
district to meet with consultants and administrators to 
identify the basic elements needed in a district school 
improvement plan. Over the summer of 1984, another 
larger representative group attended an Effective 
Schools Institute in Michigan sponsored by Michigan 
State University and organized by Dr. Lezotte. This 
group of 13 included consultants, nine principals who 
had volunteered to be part of Phase I, and the 
teacher's association president. Upon their return they 
made a presentation to inform other consultants and 
principals. As support increased for adopting the Ef- 
fective Schools process, formal committee work 
began under the direction of Deputy Superintendent 
Dr. Wettergren, and a formal implementation plan 
was written. Due to the large size of the district (34 
schools), the decision was made to phase in the pro- 
cess over a 3-year period beginning with nine Phase I 
schools in 1984-85. Principals in these schools, along 
with their staffs, had chosen to be in the first group. 
Phase II schools began in 1985-86, with the last 12 
Phase III schools joining the process in 1986-87. This 
allowed the district to provide appropriate and neces- 
sary staff development and support for each group of 
schools as they began. 

Funding 

Because the administrators considered Effective 
Schools a process to bring purpose, coordination, and 
focus to many existing programs, the district did not 
consider it to be a large additional expenditure. The 
curriculum study and review process already included 
committee and curriculum writing time, and the staff 
development program included an extensive instruc- 
tional improvement component. The district was al- 
ready on its way toward consistent district curriculum 
and a testing program that included both standardized 
testing and locally developed criterion-referenced test- 



66 



Case Studies in Effective Schools Research 



ing. In addition to these efforts, several other budget 
areas were affected. 

In January 1985, a central office position was cre- 
ated to coordinate the development and implementa- 
tion of the Effective Schools process. This temporary 
position, titled the Effective Schools Administrator, 
was an additional salary item. Although the position 
was to have been terminated June 1987, it became 
important to supporting and sustaining the program 
once all schols were phased into the process; there- 
fore it has been continued. 

As part of the staff development, instructional im- 
provement focus, the district created positions called 
resource teachers. These positions were developed as 
a result of research which emphasized the need for 
highly trained, in-building staff developers to bring 
instructional skills from awareness levels to levels of 
classroom application. The staffing allocation is ,5 
PTE in each elementary school (one staff member) 
and 1,2 PTE for each secondary school (two staff 
members). In order to retain their identity as teachers, 
and credibility with other teachers, each elementary 
resource person teaches in the classroom approxi- 
mately one-half time, while at the secondary level, 
the two people each teach two classes per day. Dur- 
ing their non-classroom time, they are responsible for 
direct instruction and follow-up of their building staff 
on matters pertaining to instructional improvement. 
That part of their salary is considered a staff develop- 
ment cost. 

Another staff development cost has been released 
time for building leadership teams (BLTs). BLTs are 
school improvement teams of building staff members 
who assume leadership for development and imple- 
mentation of school leadership for development and 
implementation of school plans. As each building en- 
tered the process, they were allocated four days per 
BLT member for training and building planning days. 
That has continued since 1984, but in 1988-89 the al- 
location will be reduced to three days per BLT mem- 
ber. 

The BLT training and building school improve- 
ment plans have brought great focus to staff develop- 
ment efforts. Staff members have always been re- 
leased for a variety of professional pursuits. Now, 
however, the fragmentation of these efforts is disap- 
pearing, and instruction and student achievement have 
become the focus of attention. 

Program Support 

In addition to the budgetary support described 
above, Effective Schools has been supported in a 
number of other ways over the past 4 years including: 



• Continued public verbal commitment from the su- 
perintendent and the school board 

• District publications featuring articles on varying 
aspects of Effective Schools 

• Visits by the superintendent to BLT meetings 

• Visual displays of the mission statement on district 
banners and stationery 

• BLT presentations of their action plans to the 
school board 

• Strong support of Effective Schools by the two as- 
sociate superintendents 

• Continuation of the Effective Schools coordinator 
position 

• High visibility by the Effective Schools coordina- 
tor at all BLT training sessions, on district commit- 
tees, and at many BLT meetings and building staff 
meetings 

• Inclusion of Effective Schools goals in many indi- 
vidual district personnel job targets 

Evidence of Improvement: 
Measured Student Outcomes 

What evidence does the district have that schools 
are improving? The Anoka-Hennepin School District 
recognizes that formal assessment and evaluation of 
student achievement is one method of evaluating the 
effectiveness of instructional programs and of judging 
the success of students in acquiring essential knowl- 
edge and skills. Measurement of student achievement 
is of greatest value when the information is used in 
concert with professional observation and judgment. 

The student assessment coordinator works with dis- 
trict curriculum consultants and teacher committees to 
develop learner outcomes and criterion-referenced 
tests. She also presents sessions to BLTs on interpre- 
ting and using test data within their building, Anoka- 
Hennepin has developed a long-range testing plan to 
coordinate and integrate all activities in this area. Test 
results are displayed to the public by district aver- 
ages, and test results are shared with each school staff 
by building average and individual score (Iowa Test 
for Basic Skills) and by classroom average and indi- 
vidual score (criterion-referenced tests). The district 
started gathering baseline data in 1985-86, 

During the 1987-88 school year, Anoka-Hennepin 
changed from administering the California Test for 
Basic Skills (CTBS) to the Iowa Test for Basic Skills 
(ITBS). The ITBS was selected because it was 
thought to have a better fit to the Anoka-Hennepin 
curriculum and programs. Norm -re fere need tests are 
conducted for the following purposes: 
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• to assist in making decisions regarding individual 
students 

• to provide information to curriculum committees to 
be used in evaluating programs at school and dis- 
trict levels 

• to report to parents the performance of each stu- 
dent in the areas tested in relationship to the per- 
formance of a much larger group of students 

• to report to the community the level of achieve- 
ment in basic skills attained by students in the dis- 
trict. 

Outcomes. While 56 percent of the students ranked 
above the national average in reading in 1985-86, the 
number moved to 63 percent in 1986-87. The number 
of students taking the PSAT has jumped from 937 in 
1983 to 1,265 in 1986, a 35-pcrcent increase, while 
scores have remained stable. 

Anoka-Hennepin curriculum teams began writing 
criterion-referenced tests in limited content area in 
1985-86 and have continued to add to the content 
areas and refine existing tests. The assessment of per- 
formance on criterion-referenced tests related to es- 
sential learner outcomes is conducted for the follow- 
ing purposes: 

• to assess the impact of curriculum and instructional 
practices within the content areas 

• to determine if there are substantia] differences in 
performance among schools or groups within 
schools in demonstrating mastery of essential 
learner outcomes 

• to determine which individual students are master- 
ing essential outcomes and which students are not. 

Several figures arc included as examples of how 
Anoka-Hennepin reports district criterion-referenced 
test data to the public. Individual buildings have their 
own data available to interpret. Individual buildings 
also disaggregate on the basis of gender and children 
receiving free-and-reduced lunch. The following dis- 
trict examples show specific grade levels in secondary 
social studies (Table 1) and elementary mathematics 
(Figures 1 and 2), 

In addition to focusing on student achievement, at- 
tendance and dropout problems also became a student 
outcome focus of the district in 1987-88, A major 
study showed that during 1986-87, 4,5 percent of the 
total high school population dropped out before grad- 
uation. Although that is a small percentage, it still 
rcprescnied 342 individuals who may have been kept 
in school. These data and the new 1987-88 data will 
serve as baseline data for Anoka-Hennepin*s work in 
dropout prevention. Consideration is also being given, 
at this time, to adoption of a consistent attendance 
policy district-wide next year or m the near future. 



How Does the Effective Schools Process 
Affect the Way Student Achievement 
Cutcomes Are Measured? 

Disaggregated data fosters accountability. Disag- 
gregated analysis of norm -referenced data may be 
conducted for specific purposes. The nature of the 
disaggregation must be determined each year prior to 
the administration of the tests. Once the purpose has 
been accomplished, the disaggregation will be discon- 
tinued. 

Individual buildings may disaggregate their test 
data on the basis of gender or socioeconomic status 
(SES), Anoka-Hennepin buildings range from 7 per- 
cent to 23 percent of the students on free-and-reduced 
lunch programs, one indicator of SES, 

Development of criterion-referenced tests. Anoka - 
Hennepin has a long-range plan for the development 
of criterion-referenced testing, with the use of com- 
puter-managed instruction (CMI) contributing greatly 
to the efficiency of the program. Mathematics, sci- 
ence, social studies, health, and art administered 



Table 1 

Social Studies Scores Improvement 



Comparison of Percent of Students Who Achieved 
Mastery in 198^-^1987 over 1985^1986 

Social Studies, Grade 7 



Units of Instruction Percent of Change 


1, 


Map Skills 


Same 


2. 


Graph Skills 


+18% 


3. 


A Worid of People 


+16% 


4, 


Feeding a Hungry World 


-7% 


5. 


How Mtich Do People Have 


Same 


6. 


Worldwide Communication 


+ 19% 


7. 


World Cultures 


Same 


d. 


People In Government 


--10% 



Comparison of Percent of Students Who Achieved 
Mastery In 1986-1987 over 1985-1986 
Social Studies, Grade 9 

Units of Instruction Percent of Change 

1 . Roots of American 

Government +14% 

2. Political Parties/Elections +29% 

3. Executive Branch Same 

4. Legislative Branch +22% 

5. Judicial Branch + 1 9% 
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Percent of Students who Achieved Mastery in 1986 and 1987 



- 1986 

- 1987 



UNIT OF STUDY 



Grade Three Mathematics 

0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 




Figure 1. Percentage of Students Achieving Mastery in 1986 and 1987 

Percent of Students who Achieved Mastery in 1986 and 1987 



Grade Five Mathematics Jjj^ _ 

UNIT OF STUDY O 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 




|66 


Read numbers lo 9 digits | 




Esiimate by rounding ] 




Subtract 5 -digit whole numbers 




Multiply by 2/3 digits | 


1 81 


Divide by 1 /digit with regrouping 




Divide by 2 digits 


I 64 




Reading decimals 






Adding decimals 




Subtracting decimals 




Fractions/mixed numbers 


t 38 


Word Problems 


^ 178 




Graphing 


I not included on 1986 test 





Figure 2. Percentage of Students Achieving Mastery in 1986 and 1987 



ERIC 



criterion-referenced tests in 1987-88 to determine 
whether or not students have learned the skills estab- 
lished as essential learner outcomes in each area. In 
1988-89 the elementary schools CMI will function 
with reading and math. Additions of new content 
areas to CMI will be based upon readiness of the cur- 
riculum, costs of hardware, interest of leaching staff 
in mastery learning concepts, ability to handle data 



entry, training, and importance of immediate feedback 
lo achievement of essential outcomes. A plan to guide 
district assessment has been included in Appendix A 
because it briefly describes the extent of Anoka- 
Hennepin's process. 

To fulfill the district mission **Every Student Will 
Learn,'* a program has been developed titled **As- 
surance of Basic Learning.*' Students will be required 
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to demonstrate mastery level in math and reading, and 
those who do not pass will continue to receive in- 
struction in the basic skill areas they have not yet 
mastered. Students will be re-assessed yearly until 
they pass. In preparation for 1988-^9 implementation 
of this program, committees carefully considered 
questions of mastery level requirements, test selec- 
tion, counseling services, remediation, and a strong 
support system for students identified as needing as- 
sistance. 

How Have Professional and General 
Staff Development Programs 
Changed As a Result of the 
Effective Schools Thrust? 

In the past few years, the staff development pro- 
gram has changed extensively. The first change is in 
the movement toward a building-based approach. This 
made sense because each resource teacher became a 
highly trained staff developer conveniently placed in 
each building. Second, buildings organized their staff 
development around the goals of their action plans, 
therefore, district-wide inservice training seemed less 
appropriate. Also, the goal of staff development be- 
came that of application, not just awareness of skills. 
Last, even though staff development still includes 
many aspects of education, the major mission is to ef- 
fect student learning and success. The Effective 
Schools program has helped to focus on that mission. 

During 1987-88, 450 (25 percent) district staff 
members participated in building-level training on the 
Elements of Instruction by their resource teacher. 
The training consisted of four days (release time) of 
direct instruction and opportunities for several class- 
room follow-ups by the resource teacher and/or other 
colleagues. The participants were surveyed in late 
May on the effectiveness of the training **to increase 
their understanding of 18 teacher behaviors and in- 
structional techniques." With 0 meaning no increase, 
1 meaning somewhat of an increase, and 2 meaning a 
great deal of increase, the average response was a 
1.38. Scores ranged from a low of 1.21 to a high of 
1.58 on various teacher behaviors of the 18. The 
strongest results came from the category of teachers 
with 0-3 years of experience. A very complete statis- 
tical analysis of the survey is available, but too 
lengthy to include in this report. 

What Else Has Developed In Relation 
to the Effective Schools Process? 

Policies, procedures, practices. During interviews 
to hire new employees at both the district and build- 



ing level, candidates are asked to describe their 
familiarity with Effective Schools Research and in- 
structional improvement practices. New employees 
are brought on-line as soon as possible with regard to 
this knowledge. 

Discussion and decision-making about grading and 
attendance policies, grouping practices, new cur- 
riculum adoptions, staff development plans, instruc- 
tional delivery, and program selections usually con- 
sider Effective Schools Research. This focus has not 
eliminated conflict over these issues, but in general, 
decisions in these areas focus more specifically on 
student outcomes and success in Anoka-Hennepin 
schools. (See Appendix B) 

What Other Problems, Issues, or 
Concerns Were Encountered? 

State statute requires each school district to publish 
annual reports to its citizens on district activities re- 
lated to planning and evaluating educational pro- 
grams. These reports are based on the work of the 
Planning, Evaluation, and Reporting Committee 
(PRE), composed of Anoka-Hennepin citizens and 
district staff. As district work on curriculum review, 
learner outcomes, and criterion-referenced testing has 
become more sophisticated and complete, the statute 
requirements of the State of Minnesota have paral- 
leled district direction. 

The State of Minnesota recently enacted legislation 
requiring districts to spend a certain per-pupil allot- 
ment of their funding on staff development and to 
provide proof of that expenditure to the state. Anoka- 
Hennepin was already in compliance with that spend- 
ing requirement. 

Several issues developed within the district which 
required consistent communication and perseverance. 
The message that curriculum, **what we teach," is 
the heart of the mission needed to be more clearly un- 
derstood. Staff perceived a definite conflict between 
the concept of being '*building-based'' and the con- 
cept of '^consistent district-wide curriculum.'* 
Through continued curriculum committee work and 
test writing committees, the perceived conflict began 
to diminish. Also, focusing Effective Schools staff de- 
velopment on curriculum issues, and connecting cur- 
riculum development and instruction more tightly, is 
helping to resolve the issue. 

Qitcrion-refercnced testing has also been a district 
Issue. The concept of assessing, at a district level, 
whether students have mastered what they had been 
taught was unfamiliar to many teachers. Some 
teachers had some doubts and misconceptions con- 
cerning the use of those test data. The district tried to 
assuage those doubts by using the test data ap- 
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propriately to evaluate programs and instructional 
practices and to assess mastery by individual students. 
Consistent, appropriate use of those data will develop 
trust and help overcome that conflict. 

Reduced revenue and increased expenses in 1987- 
88 have required Anoka-Hennepin to enact budget 
cuts for 1988-^9. The district believes that all the 
programs now offered are important to the success of 
students. It has been determined that about half the 
cuts will come through staff reduction and the other 
half through non-salary items. The Effective Schools 
staff development budget has been reduced by the 
same percentage as other budgets. 

Advice For Other Schools? 

After four years in the Effective Schools process, 
district programs and priorities seem focused on the 
tasks of the mission. Staff development is centering 
on instructional improvement skills and student affec- 
tive and academic success. Curriculum is being 
strengthened by development of learner outcomes. 
The staff in the district is becoming more attuned to 
student assessment and how to use the data effec- 
tively to improve programs and instruction. The ques- 
tion is often asked, why didn't the process start with 
this focus? The Effective Schools process is a gradual 
one that involves slow changes in attitudes and prac- 
tice. To expect an abrupt change in focus and practice 
would be an unreasonable and impractical expecta- 
tion. However, several ideas mentioned by different 
groups and individuals in the district could be added 
to the steps w hich were taken. 

As a result of staff assessment, the building princi- 
pal might feel exposed and vulnerable. The process 
can be harsh and threatening in some situations. For 
the third phase of school improvement, informal 
meetings were organized for principals to get together 
with building staff to share ideas and discuss the pro- 
cess. This might have helped the earlier groups feel 
more comfortable with the process and feel supported 
by their colleagues and the central office. 

As described earlier, Building Leadership Teams 
(BLTs) received four days each year in staff develop- 
ment and planning time. The staff development con- 
sisted of background on Effective Schools Research, 
leadership training (trust building, team building, and 



conflict resolution skills), research on change, training 
to write action plans, and inservice on specific Effec- 
tive Schools correlates. Although the principals were 
part of the team training, they could also have bene- 
fited from additional training and support on partici- 
pative management skills. For some, they were, for 
the first time, being asked to manage their building in 
styles quite different from their own leadership. In- 
volving staff in decision-making through the BLT was 
a new concept to some and additional knowledge and 
skills might have eased the transition. (See Appendix 

Q 

Although a number of specific curriculum consul- 
tants reviewed the Effective Schools Research and 
were part of the initial training group, they were not 
involved in the leadership training which BLTs re- 
ceived over the first few years. Therefore, when BLT 
began to **grab hold'* of student achievement data 
and question curriculum and instructional practices in 
their buildings, consultants were not in a comfortable 
position to interact with the groups. The integration of 
curriculum and instruction might have more naturally 
occurred if the curriculum consultants had been in- 
vited to participate in the same training as the teach- 
ing staff and principals had received. 

Summary 

The original district school improvement plan was 
to build upon current practice v/hile focusing upon 
the theme that * 'things can be better.'* A significart 
feature of the plan was to assess existing conditions 
with specific attention to how the district could im- 
prove what it perceives as strengths while also ad- 
dressing its perceived weaknesses. The Effective 
Schools process provides a research base to assess the 
quality of current practices and a building-based pro- 
cess to implement necessary improvements. 

The process has not been without conflict. How- 
ever, many of the disagreements have revolved 
around issues of significance — funding priorities, cur- 
riculum, grouping for instruction, instructional skills, 
and student assessment and success. The Effective 
Schools process has provided a vehicle to focus atten- 
tion on issues of great importance to students in the 
Anoka-Hennepin School District. 
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APPENDIX A 
Anoka*Hennepin Assessment Plan and Process 




A commlJte0 of ttaff «nd pardnte ^xaimlrvod thd dlslri<^*«'kM iMtina #ffwt» «n(i <toV0lop«d a plan to yuide assessment In 
the future.;..;. 

Tha pita ;og«n«» aif :th# district wkie tosti ihitf will t>a yimii^ jn th« loreU^abte future. It also explains how the data 
for each tei^ w(K be uaed and who wil receWe reporta of thi'aooree.,. 

P^'^'^**^ » requked by the 1968 Planning. Evaluatiha, f^epofiing ipEPt^ legiclatJon* w»» be reviewed annually and 
mvrfsed H/iiieoes«afy, 




NORM-REFERENCED TESTING PROGRAM 




TEST 


GRADES 


resuItsUpurpose 


USE OF DATA 


Iowa Tests of Basic Stalls 

Tests of Achievement and 
Proficiency 


2, 4, e 

9 


basic sWte compared to other students In 
natidhaf sample ,! 

neeoifig, Mam, Language nererence okute 


Parent reports, 
class placement, 
remedial 
decisions. 
Assurance of 
Mastery, school 
improvement 




4. 6. 9 


National percentile score to assess strengths 
and weadcnesses In skill areas, and in abstract 
feasoning. Detennine If achievement is at 
appropnate level. 


Parent reports, 
teacher 
information, 
identification for 
gifted programs. 


PSAT ACT, SAT 


11, 12 


Special scores for each test to show ability in 
math and verba) skiys. 


Required for 
admission to most 
colleges 


ijeveiopjng LKignnive 
AblHtieeTest 

Music Aptitude Proffle 


Above 88th 
percentil on ITBS 

4 


National peroentite show differences in abiitty 
and achievement among top students. 

National percentile to show differences In 
musical talent 


tdentifioation for 
gifted program. 

Music instruction 
and guidance of 
students 


Physical Fitness Profile 


1-6 


District percentile to show (eve) of physical 
fitnesa. 


Teachers, parent 
report 




CRITERION REFERENCED TESTING PROGRAM 




TEST 


GRADES 


results— PURPOSE 


USE OF DATA 


Rsadtng on CMI 
Math on ChM 




Mastery of objectives for each unit to guide 
Instruction and evakiate curriculum. 


Teachers, parent 
reports, staff 
committees. 


Degrees of Reading Power 


6 & 9 
Lower 

25% ITBS 


Scale score to determine ieveJ at which students 
read. 

Scale score to detemiine level at which students 
read. 


Assigning students 
to reading classes. 
Assurance of 
Basic Learning. 


ABL Math Teat 


8 


Mastery or non-mastery of 37 basic math skills. 


Assurance of 
Basic Learning. 


Language Arts 
WfWng Sample 


3 & 9 


Score l-'ia to assess writing 


Teachers, 
committees 


Spelling teat 


4&6 


Asaees student (earning of words taught in 
cufTicufum* 


Teachers, 
oommlttees 


Ehd-of*Year Assessments 


Math, Science, 
Social Studies, 
&)gKsh, Home 
Eoonomtcs 


Mastery or non-mastery of essential learner 
outoomea 


Teacf^ers, 
principals 
ounriculum 
committees 
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APPENODCB 

How Has the Effective Schoor Process Influenced 
and Changed the Various Program Components? 

The Anoka-Hennepin Phase I schbbts have just coiirtpleted a 3^year cycle which included assessment, 
planning, and implettentation of their school improvement ptaa At this time, the on V schools which have 
reassessed the presence of the correlates are scJwirls that cjiian^ btgWlng principals during the cycle. 
Throughout Anoka-Hennepin's involvemert in Effective Schdbte. changes have occurred at two levels, distnct 
and building. The most crucial changes at the distrfct level Were ttibse Inyolvfng alignment and consistency of 
the curriculum and development and admtnistratton of crfteriori^ref^erwed^ These changes are ongoing 
and are documented through the curriculum review' pibdess Sand t»w, district testing plan. 

At the building level, changes focus on the use of test data: to fenprove student learning and the involve- 
ment of the staff in making decisions about teaching and learning. This process and an evaluation of its 
results is documented at each building through its written school improvement plan. These plana are updated 
yecirly. 

The curriculum. Effective Schools helped to bring to sharper focus a study and review process that 
began in Anoka-Hennspin in 1976. The BLT process helped to initiate discussion and research on the issue 
of curriculum and district mission at the building level. Many elements working together, such as curnculum 
committees, criterion-referenced test writing, and BLTs. brought curriculum issues to the forefront of distnct 
and building effort for students. 

Program implementation. At this point, the district is on its second curriculum study and review cycle, 
and clarification of purpose would naturally be occurring. However, the work of district curriculum committees 
and BLTs have focused on our basic purposes in education, and have helped determine If imfrfementation of 
a new program would further that purpose. 

Program evaluation. Because BLTs have more access to Information about attendance, grades, drop- 
outs, and other data indicating student success or failure, program evaluation has become a more open and 
informed process. The district also began parent and student surveys during 1987-88. These data will pro- 
vide baseline Information for future comparisons. 

Staff evaluation. A Teacher Performance Review System has been functioning in Anoka-Hennepin since 
1981-82. The system involves teacher observation, principal feedback and evaluation, and teacher job tar- 
gets. During 198e-88. a committee reviewed the system and is now formulating recommendations for 
changes. Possible changes involve timelines and frequency of obsen/ation. format for principal feedback, and 
expansion of the job target idea Several of these changes may have been partially a result of the Effective 
Schools process. Through extensive training, principals have become more expert at observing, conferenc- 
ing, and working with teachers on instnictional improvement. Also, resource teachers are available as an- 
other source of assistance to teachers for instructional skills. Teachers are also connecting many of their 
personal job targets to their building school improvement plan goals. 

The principals' evaluation now includes observatton and feedback on their conferencing skills with the 
teachers. This is completed by the associate superintendents for rtementary and secondary education. 

Position descriptions. Several professional positions now Include rotes and responsibilities related to Ef- 
fective Schools process. The resource teachers, principals, associate superintendents, and Effective Schools 
coordinator are such positions. 

Community attitudes. Parents appreciate the opportunity to participate in the schools through advisory 
groups, curriculum committees, volunteer jobs, and parent surveys. Individual buildings are just beginning to 
focus on establishing parent/school partnerships through their school action plans, so the district is looking 
forward to continued improvement in the area 

Sen/ice and funding agencies. Because of the high visibility of the State of Minnesota Effective Schools 
program, it Is a distinct benefit to be involved In the process throughout the AnoKa-Hennepin district. District 
pereonnel can gain training through the state Educational Cooperative Service Unit (ECSU) because many of 
the staff development programs match Anoka-Hennepin's In topic and content. Also, the emphasis on student 
outcomes and assessment fit the national educational agenda. 

Recognition of the instrucUonal process. An awareness and commitment to the importance of the instruc- 
tional process has greatly increased through Effective Schods. Through study and insen/ice on the corre- 
lates and a commitment to the resource teacher posftion and role, teachers and principals have focused on 
the Impact of insb^uction upon student outcomes. 

.. . . ^ 
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APPENDIX C 

What Are the Components of the Effective Schools Planning Process? 

Dlstrlct-tevet coordinating team. A District Eff6<jtfv6 Schools Steering Committee has been 
in existence since 1984. The committee^s role is to monitor and make recommendations related to 
the implementation and maintenance of ttie school improvement process district-wide. In 1988-89, 
parents will be added to the committee which now consists of teachers, district administrators, and 
principals. 

District-wide involvement. The Effective Schools process has had wide involvement in 
Anoka-Hennepin since the beginning. Initially, district administrators, the school board, teachers, 
principals, and consultants all considered research and information about Effective Schools. After 
district adoption of the process, all centra office and building administrators received inservice 
training from Dr. Lezotte, and the district continues to send new administrators to introductory 
workshops otJt of the district As buildings joined the process through the phases, all BLT mem- 
bers attended workshops to become familiar with the research and the process of Effective 
Schools. 

The school board and superintendent have remalried well informed and actively involved in 
Effective Schools. TTie school board was involved in a presentation on Effective Schools in 1986- 
87 at the Nat'Ciial School Board Association (NSBA) in San Francisco, Because they initially 
helped deterrr.ine the district mission and fully understand the philosophy of Effective Schools, 
board memi^ars show concern that normal operating policies and decisions are in line with the 
mission of the district The superintendent attends building meetings when possible and has set a 
goal to attend at least one meeting at each building during 1988-89. 

Beginning last year, 1987-88, parents and students became more involved in the process. 
Parents, students, custodians, cooks, and paraprofessionals have all served on a number of sec- 
ondary BLTs, and parent and student surveys have solicited wider input from those two groups. In 
1988-89, parents are being added to the district steering committee. 

At the building level, BLTs considered their first task to be one of providing meaningful in- 
volvement for the entire staff in the process of Effective Schools. Every school has established 
some form of small, networi<ing groups which serve to enhance clear and two-way communication. 
With staff turnover and transfers, this issue requires continuing attention by the BLTs to maintain 
and improve channels of communication, 

Schooi-based teams. Building leadership teams, initially consisting of principals and teach- 
ers, were established as each school joined the Effective Schools process. Members were se- 
lected in a variety of ways, depending upon the process which the building and principal chose. 
Principals were advised to build a diverse team based on teaching experience, gender, depart- 
ment or grade I s/el, and other factors. 

Timeiines were suggested for teams, with considerable flexibility available to the buildings. 
During the first year, teams were identified, orientation and education of the teams took place, 
teams established communication structures, correlates and indicators were reviewed by the entire 
staff, and a building assessment of the presence or absence of the con-elates was conducted. The 
second year involved developing school improvement plans, with extensive staff participation In 
prioritizing, goal setting, and brainstorming ideas. Implementation, monitoring, and review of the 
plan took place during the third year. From there fonvard, the process becomes cyclical in nature, 
with teams and staffs continuing to evaluate their progress and set new goals for the future. 
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Glendale Union High School District 

Became involved In Effective Schools process in 1982 



cornrnunrry 




School District 




Population 


EnroIlm#nt 




Area (in square miles) 




300,000 


14,000 




60 




Metropolitan Phoenix, Arizona 


Ethnic Composition (p«rc#nt) 


Number of Schools 




African- American 


2 


High schools 


9 


The economic base of 


American Indian 


1 






Glendale consists of a mix of 


Asian-American 


3 






electronics companies, small 


Caucasian 


83 






businesses, professional offices, 


Hispanic 


11 






construction trades, and tourism 










(many resorts). Largely 


P«r PupK Exp#nditur« 


$3,264 


Number of Staff 


45 


residential; some agriculture. 


1988^1989 


Administrators 


Most residents are middle to 






Certified teachers 


568 


upper class with a few lower 






Support staff 


608 


socioeconomic families. About 










60 percent of homes have no 






Student'Teacher Ratio 




school-age children. Near 






High school 


20:1 


Glendale Is the Arizona State 










Extension campus and one of 


P0rc«nt bussed 




Percent college-bound 




the state's largest community 


12 




80 (based on survey 




colleges. 






of graduates) 





Abstract 



Although the nation has now developed 
some knowledge about school improvement in 
secondary schools, Glendale Union's experi- 
ence is especially interesting from a research 
point of view. The district began its school im- 
provement program in 1972 by putting in place 
an '^ambitious accountability program de- 
signed to evr. uate the instructional program 
and student achievement in a centralized, sys- 
tematic fashion." This approach preceded the 
development of the Effective Schools model by 
almost a decade. 

By 1982, Glendale Union had several addi- 
tional efforts underway: innovative testing sys- 
tems, a curriculum planning process, and crite- 
rion-referenced tests based on district-wide 
teaching objectives. The instructional manage- 
ment system (IMS) was probably the first of its 
kind in the nation. Despite the improvements, 
there was a feeling that much of the 
"accountability" had led to more centralized 
decision-making than many staff members de- 
sired. Principals and teachers wished to partici- 
pate in more decisions, especkally those that af- 
fected their ability to set the stage for 



Increased achievement for all students. The dis- 
trict sought an organizational structure that 
would promote the systematic flow of informa- 
tion from campus to district-level personnel with 
regard to testing, curriculum planning, and 
school improvement in general. 

The evolution of these beliefs led to the cre- 
ation of a new staff position. Administrator for 
Effective Schools, and sparked a planned pro- 
cess of change based on the Effective Schools 
model at all district schools. From the begin- 
ning, the superintendent and board supported 
the process. 

Early on, the district had to define terms, in- 
cluding ''school effectiveness." From these def- 
initions the interested reader can discover the 
basic rationale of Glendale Union for introduc- 
ing and sustaining the process and the philo- 
sophical commitment to the measurement of 
outcomes that undergirds the Effective Schools 
model. Assessment procedures are also specif- 
fcally described and their indicators are to this 
day useful in assessment processes of Effective 
Schools. 



80 



School Effectiveness at the Secondary Level-Glendale 77 



Origins of the Glendale Union 
School Effectiveness Model 

In the fall of 1989 the Glendale Union High 
School District (GUHSD) began its eighth year of 
school effectiveness planning, assessment, and im- 
provement. Located in suburban Phoenix, the district 
contains nine four-year high schools and a student en- 
rollment of approximately 14,000. About 17 percent 
of the students are from minority backgrounds, with 
the largest minority group from Hispanic families. 
The Glendale Union School Effectiveness Model is a 
product of the district's long commitment to educa- 
tional accountability. The origins of the model, its 
unique features, and its influence on students are 
complex and comprehensive. 

All beginnings are difficult. This axiomatic insight 
became the daily experience of administration and 
faculty in the district in 1972. During that pivotal 
year, the district launched an ambitious accountability 
program designed to evaluate instructional programs 
and student achievement in a centralized, systematic 
fashion. At the time, such programs were rare and the 
term "accountability" was merely the latest addition 
to the current educational lexicon. Without any mod- 
els to emulate, GUHSD moved forward by drawing 
upon the expertise of several measurement research- 
ers. Within five years, the district succeeded in devel- 
oping an instructional management system, which has 
become recognized for its leadership role in criterion- 
referenced testing. 

By 1982 teachers were heavily involved in innova- 
tive test development and curriculum planning. A va- 
riety of staff development efforts were underway and, 
most importantly, student achievement was moving 
upward. Yet internal dissatisfactions with the system 



[Editor's Note: For clarity and consistency wc have changed the 
name ••School Effectiveness model" which Glendale Union es- 
pouses to the * •Effective Schools model*' in most references in this 
case study. When Glendale Union was building its model, effective 
schools and school effectiveness were interchangeable in most cases 
(1976-1984). After 1984, the two terms became more specific; 
•'school effectiveness" connoted a school improvement program 
emphasizing quality considerations, and ''effective schools" contin- 
ued to emphasize quality and equity components. 

Today (1989), Effective Schools (capitalized) denotes the 
comprehensive model espoused by the National Center for 
Effective Schools (founded in 1987), and Glendale Union has 
used this model. Glendale Union still uses the term ''school 
effectiveness." however, because it has always eharactorized 
the Effective Schools Research this way. The National Center 
salutes them in their development of the Effective Schools 
process we espouse today,] 

^Marc Becker and Janet Barry bring their Effective Schools 
Invohrement to the preparation of this chapter. Dr. Becker pro- 
vides technical support for the district's Effective Schools pro- 
cedures, including an extensive criterion -referenced testing 
program. Ms. Barry provkJes broad leadership in curriculum, 



became evident and had to be understood and re- 
solved. Administrators and teachers within Glendale's 
nine high schools were concerned that the district's 
accountability system had become too centralized. 
Local schools wanted more influence in the decisions 
that affected student achievement and program plan- 
ning. Many teachers thought the district-wide testing 
program was too focused on cognitive achievement 
and ignored other school-specific variables which 
contribute to the success of students and programs. 
Most wanted to know whether increases in student 
achievement could be sustained among students from 
lower socioeconomic backgrounds. 

The climate of questioning which existed in 1982 
gave birth to the Glendale Union School Effective- 
ness Model. Drawing upon the emerging body of 
school effectiveness research, the district created a 
new position. Administrator of Effective Schools, and 
hired CM. **Mac'' Bernd. Dr. Bernd, who later be- 
came superintendent of schools in San Marcos, Cali- 
fornia, spearheaded a three-year developmental effort 
which resulted in the model in use. Since its in- 
ception, the model was supported by district funds as 
an integral part of the district's educational program. 

School Effectiveness: A Definition 

The initial task confronting GUHSD was to estab- 
lish a model of school effectiveness which would bal- 
ance the demands of district-wide accountability with 
school-based decision making. After long debate, a 
district steering committee arrived at a definition of 
school effectiveness which would embrace both stu- 
dent achievement and the correlates of Effective 
Schools, as identified in the research of Curran 
(1983), Edmonds (1982), as well as Brookover and 
Lezotte (1979). The correlates, specific to the organi- 
zational climate and functioning of schools, laid the 
foundation for the establishment of a local, decision- 
making process on each school campus. Before de- 
scribing this process, it is instructive to examine the 
Glendale Union definition of school effectiveness and 
to look at the district's measurement of student 
achievement. 

The GUHSD definition of school effectiveness 
reads as follows: 

An effective school in the Glendale Union High 
School District is one which assures (1) 
measurable academic achievement and (2) 
observable growth in emotional maturity, 
physical well-being, and social responsibility by 
all students. 
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Eight correlates of school effectiveness are known 
throughout the district as the * 'eight characteristics." 
They consist of the following: 

1. clear and specific school purpose 

2. strong educational leadership by administration 

3. high expectations for students and staff 

4. school partnership with parents and community 

5. positive climate for learning 

6. frequent monitoring of student progress 

7. emphasis on the attainment of essential skills 

8. high level of faculty commitment to the educa- 
tional program. 

Each characteristic is defined by a specific set of 
indicators developed by faculty representatives from 
each school. The indicators for each characteristic are 
listed in Table 1. 



School Effectiveness and 
Student Achievement 

The measurement of student achievement occupies 
a prominent position in Glendale Union's definition 
of school effectiveness. This is not surprising in view 
of the district's criterion-referenced testing program 
and long-term commitment to accountability (see 
Table 2 for a description of the GUHSD testing pro- 
gram). With the advent of the Effective Schools 
inodcl, abundant longitudinal data on student perfor- 
mance in the core curriculum was already available. 
The decision of whether or when to test was not an 
issue. At stake, however, was the way in which test 
results were being reported. Administrators and fac- 
ulty across the district asked that differences in stu- 
dent background be considered in the summary of 
student achievement (a sample student achievement 
report appears in Table 3). Some teachers claimed 
that students from **poor" families could not be ex- 
pected to learn as much as their more affluent peers, 
others disagreed. The Effective Schools Research, 
with its dual emphasis on quality and equity, prom- 
ised to shed some light on the issue of student back- 
ground differences and their influence on student 
achievement. 

The concept of quality is certainly not new in edu- 
cation. Few educators would quarrel with the notion 
that effective schooling can produce high student 
achievement. In Effective Schools, however, research- 
ers found that achievement was distributed fairly 
evenly across subgroups in the student body, regard- 
less of differences in family or home background. 
The term used to describe this distribution is * 'eq- 
uity.'' Equity can be determined by dividing the stu- 
dent population into subgroups, based upon socioeco- 
nomic or demographic variables. Student achievement 
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is then reported for each subgroup and is known as 
the "disaggregation of data." 

Like most school districts across the country, Glen- 
dale Union had been preoccupied with quality (high 
scores). The developers of the Glendale Effective 
Schools model turned the district's attention to equity 
(well distributed scores) as well as quality. Tne result 
of their effort is a school effectiveness profile for 
each of the district's nine high schools. It is instruc- 
tive to describe the district's d^.fmitions of quality and 
equity while examining a typical school profile. 

Table 4 presents a school effectiveness profile for 
one school. Part I in the school profile is labeled 
'^Quality Index" and constitutes the district's mea- 
sure of quality. The Quality Index is the average per- 
cent of district objectives that students achieve on the 
criterion-referenced tests (across subjects). The objec- 
tives are weighted on a 1-4 scale according to level 
of cognition, as determined by Bloom's Taxonomy. 
(For example, a knowledge level objective receives 1 
point. An analysis level objective receives 4 points.) 
Part I states that, on the average, students in this 
school achieved between 78 percent and 79 percent of 
the weighted district objectives over a four-year pe- 
riod. A detailed explanation of how the Quality Index 
is computed appears in the appendix. 

In establishing its definition of equity, the district 
drew upon a study conducted by Frcderickscn and 
Edmonds (1981). The study identified parental educa- 
tion, specifically mother's education, as the variable 
most strongly related to student achievement. Part H 
of the school profile (Table 4) reports the correlation 
between mother's education and student achievement 
as measured by the Quality Index. Part II reveals that 
this correlation, known as the Equity Index, has been 
relatively small in this particular school over four 
years (ranging from .14 to .18). In the Glendale 
Union district, a school is considered effective if the 
correlation between mother's education and student 
achievement is small (close to zero on a scale ranging 
from -1.00 to +1.00). 

Part III of the school profile (Table 4) summarizes 
the Quality Index, disaggregated by five levels of 
mother's education over a three-year period. An ex- 
amination of Part III reveals that students from the 
upper four levels (mothers with some high school 
through college graduate) are sustaining relatively 
high levels of achievement at this school. The lower 
performance of students with mothers who have com- 
pleted only elementary and middle school is partially 
a product of the small numbers who fall in this cate- 
gory. Beginning this year, the bottom two categories 
(elementary and some high school) will be combined, 
reducing the levels of disaggregation to four at each 
school. 
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Table I 

Charactenstics and indicators of School Effectiveness in GUHSD 


Characteristic 


indicators Within Each School 


Clear and spedlic school purpose 


School purpose is 

--deaHy stated. 

— used m decision makafig. 

-Hinderstopd by studenta/staff^rarrta. 


Strong educational leadership 
by admintstration 


Admlniatratom 

—are visible stkI accessible, 
—are responsive to faculty and sUidents. 
—are responsive to pafents/obmmunfty. 
— provide Instnictional teadershlp. 
-—maintain NCA approved pup^eacher ratio. 


H9h expectations of students and staff 


Teachors and staff 

— believe ^at all students can learn. 

— stress academic achievement 

—see. teachers as the most Important rfetei-mmants of student achievement. 


Schooi partnership with parents 
and community 


The school 

—communicates positively wfth pararrts. 
— maintains parental support networic 
Parents 

—share responsibiKty for discipline arxj achievement, 
—attend school events. 


Positive climate for learning 


The school 

—is neat, clean, and physically safe. 
— is characterized by pervasive caring. 
— rewards/fjrafses academic achievement 
—reinforces positive student behavior. 
Students 

— a<#iere to school and district rules, 
—display high time on task. 


Frequent nwnltoring of student progress 


Teachers give students 
—appropriate acsignments and practice, 
--prompt feedback for performance. 
— optimal classroom participation. . 
— multipla assessments. 


Emphcsts on student attainment of 
essential skills 


Students 

—are accountable for reading, vwiting. computing, and spelling in all classes. 
— race<vs instniction In esaentlal skills. 

Administration 

vvrniTiHiiwiu to wie tuvcntn^ pi easenuai SKaiS» 

Teachers 

—receive adequate materials lor teaching essential skills. 


High level of faculty commitment 
to the educational program 


Teachers 

—help students before, during, and after sc^)ooi. 

— hsip formulate and Implament tchoot Improvemenr goals. 

Staff 

—enforce district and school po^cles. 
— ej^lblt profes^al conduct and attiro. 
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Table 2 

District-wide Testing in the Glendale Union High School District 



The Glendale Unloh testing program is the central pillar of the district's Instructional 
Management System {IMS), a network of personnel and programs concerned with 
student assessment, staff development, and instructional improvement The 
Instructional Management System features: 

1 . District'developed criterion-referenced tests. Teachers representing each of the 
district's nine high schools are trained in the development of criterion-referenc 
tests for district-wide use. 

2. Comprehensive pre- and post-testing. The criterion-referenced tests are field-tested, 
refined, and administered annually within the district's nine high schools. Testing 
occurs each fall and spring within 17 courses spanning the district's core cun^iculum 
(language arts, math, reading, social studies science)* District-wide objectives are the 
focus of testing. 

3. Dissemination of student achievement data to various publics. Teachers and 
principals receive classroom computer printouts showing pre- and post-test 
performance of individual students. District administrators, school board members, 
and citizens are provided with aggregate student performance data 

4. Data-based decision making. Test results are used by teachers and administrators to 
make decisions about the planning of instruction, the placement or promotion of 
students, and the improvement of programs. 

5. Teacher-initiated instructional planning. Teachers wori< individually and collectively to 
diagnose student needs and generate instructional improvement plans in targeted skill 
areas. 

6. Collaborative development of instructional materials. Teachers in each of the five 
subject areas tested attend workshops to devetop instructional materials for more 
effective teaching of major skills. The materials are packaged and disseminated to 
teachers across the district 

7. Linkage to staff development programs. Through its position in the Instructional 
Management System, the testing program is supported by a variety of staff 
development programs including Mastery Learning, the Essential Elements of 
Instajction, and Clinical Supervision. 
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Student Achievement Prdf lie from QUHSD Testing 


STUDENT ACHIEVEMENT PROFILE BY TEACHER, SCHOOL. AND DISTRICT 




Subject: English -4 


iForm 510A 
% of Students Proficient 








PROG GEM310 

Mean % Mean % 
Items Corr Skis Ach 


Skills/Concepts 


1 2 


3 


4 


5 


■6. 


7 8 


■■■.9. 


10 


11 








Teacher 1 Post 
Pre 


55 98 
43 34 


71 
4 


70 
25 


91 
79 


36 
18 


54 52 
29 9 


87 

oo 


84 

O 


77 

■ 07 




74 
54 


64.9 
27.9 


Teacher 2 Pos* 
Pre 


92100 
73 92 


100 
32 


97 
62 


100 
100 


100 
38 


100 100 
81 41 


95 

7ft 


100 


97 

Of 




96 
72 


98.3 
62.7 


Teacher 3 Post 
Pre 


58 97 
50 47 


67 
11 


61 
36 


97 
89 


47 

22 


81 64 
44 6 


89 

oo • 


75 

0«7 


94 




80 
60 


75.5 
38.9 


Teacher 4 Post 
Pre 


81 100 
38 57 


95 
5 


76 
29 


95 
81 


52 
10 


100 71 
43 14 


71 
48 


95 
10 


90 
14 




97 
54 


84.4 
31.6 


Teacher 5 Post 
Pre 


55 98 
35 47 


67 
16 


69 
14 


86 
84 


61 
16 


76 47 
27 10 


73 
27 


95 
30 


88 
27 




78 
56 


70.5 
32.1 


School Post 
Pre 


65 98 
52 53 


77 
14 


74 

32 


93 
86 


56 
21 


77 64 
42 15 


75 
46 


71 
21 


88 
34 




82 
29 


76.5 
37.8 


District Post 
Pre 


74 94 
62 54 


80 
23 


69 
30 


95 
80 


62 
23 


81 76 
44 18 


75 
52 


74 
25 


86 
37 




83 
60 


78.7 
40.6 


Skills/Concepts 

1 Literary Analysis: Fictfon 

2 Literary Terms 

3 Figurative Language 

4 Spelling 

5 Standard Usage 

6 Subject/Verb Agreement 








7 Punctuation 

8 Phrases/Clauses 

9 Principles of Multi-Paragraph Writing 

10 Pronoun Usage 

11 Pronoun Reference 



STUDENTS WITH DROP ACTIVITY WILL NOT BE INCLUDED IN SUMMARIES 



GUHSD f«por1t district test data to all aohods In varying formata. Tha profHa ^>ava aummanzaa pra- and post-test student 
achiavstnant by taadiar» school, and district 1>)a paroant of studants proKciant in aadt skill la reported along with mean 
\ figures. In GUHSD. atudanta demonstrate proficiency in any gfvan skill by anawaring 75% of the test Items correctly. 
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T0bl0 4 

High School Student Effectiveness Profile* 



PART I Quality Index, 1983-87 
percent 



Explanation: The Quality Ind^ is the mean % of weighted skills 
that studentc achieve In the priority programs (core curriculum). 
Each skill was weighted according to cognitive level, using the 
Bloom Taxonomy: A SCHOOL IS CONSIDERED EFFECTIVE IF 
THE QUALITY INDEX IS high: 

PART ii Equity Index, 1983-87 

Explanation: The Equity index is the correlation between mother's 
level of education and student achievement (as defined by the 
Quality Index). A SCHOOL IS CONSIDERED EFFECTIVE IF THE 
CORRELATIONS (relationship) BETWEEN MOTHER'S 
EDUCATION AND STUDENT ACHIEVEMENT IS LOW (cfose to 
zero). 



PART III Quality Index by Five Levels of {Mother's Education, 1984-87 





19C4-85 


1985-«6 


1986-87 




percent 


percent 


percent 


Elementary 


70 


69 


62 


Some High School 


73 


72 


74 


High School Graduate 


71 


76 


75 


Some College 


81 


80 


78 


College Graduate 


84 


84 


82 


Across All Levels 


79 


79 


78 



1986-87 78 

198S~86 79 

1984-85 79 

1988-84 78 



1986-87 .14 

1985-86 .14 

1984-85 ,18 

1983-84 .16 



PART IV Coefficient of Determination (Percent of Student Achievement Affected by 
Mother'8 Education) 

percent 

1986-87 2 
198S~86 2 
1984-85 3 
1983-84 3 



*AI1 Ifguree rounded 
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Quality ond Equity: Major Findings 

Since adopting the Effective Schools model, 
the district has collected four years of longi- 
tudinal data on quality and equity* The fol- 
lowing findings have emerged within 
GUHSD schools t)etween 1983 and 1987: 

1. The Quality Index {average percent of 
weighted skills achieved) ranged from 61 
percent to 81 percent, 

2. The Equity Index (correlation between 
mother's education and student 
achievement) ranged from .07 to ,30, 

3. The percent of student achievement 
affected by differences in mother's 
education ranged from less than 1 
percent to 9 percent. 

These findings suggest that student 
achievement in GUHSD schools Is more a 
product of educational prbgrarhs and b^ars 
less relationship to differences in student 
background. The quality of student achieve- 
ment is relatively high in most schools, yeit 
there is room for improvement. As the 
model enters its seventh year, the district 
has witnessed an upward trend in studient 
achievement, accompanied by growing fac- 
ulty commitmeni to the ideals of Effective 
Schools. According to teachers, this grow- 
ing commitment is a product of the decen- 
tralized decision-maklng process whk;h 
supports the assessment of student 
achievement in the Glendale Union model. 



Pan IV of the profile (Table 4). labeled **Coeffi- 
cient of Determination/* indicates the percent of stu- 
dent achievement affected by mother's education. The 
data reveal that only 2-3 percent of student achieve- 
ment at this school has been influenced by differences 
in mother*s education over a four-year period. This 
finding reinforces the conclusion that equity com- 
bined with high quality (achievement) make this 
school Effective. 



Assessment of School Effectiveness 
and Faculty Empowerment 

A strong commitment to educational accountability 
necessitated an expanded role for teachers and staff in 
decision making. In 1982 Glendale Union faculty 



COMPUTATION OF QUALITY INDEX 

STEP 

1. ASSIGN A WEIGHTED NUMERICAL 
VALUE TO EACH SKILL IN THE 
GUHSD CORE CURRICULUM 
ACCORDING TO COGNITIVE LEVEL, 
TTie Bloom Taxonomy is employed to 
determine the cognitive level of each 
skill 

Tfie tollowng weights are employed: 
1 ^ knowledge, 2 = comprehension, 
3 - application, 4 = analysis. 

Z Compute PERCENTAGE OF 

WEIGHTED SKILLS ACHIEVED BY 
EACH STUDENT, where 

S =5 Individual skill in the core cur- 
riculum 

Sw ^ Weighted numerical value 
assigned to EACH SKILL in 
the core curriculum 
2{Sw) =5 Weighted numerical value 
ACROSS ALL SKILLS 
ACHIEVED BY A GIVEN 
STUDENT within the core 
curriculum 
n(Sw) := Weighted numerical value 

ACROSS ALL SKILLS POS- 
SIBLE FOR A GIVEN STU- 
DENT TO ACHIEVE IN THE 
CORE CURRICULUM 
^ PERCENTAGE (%) OF 
WEIGHTED SKILLS 
ACHIEVED BY GIVEN 
STUDENT 



N(Sw) 



Obtain the mean percentage of 
weighted skills achieved ACROSS 
STUDENTS WITHIN EACH SCHOOL, 

Total number of students in 
a school 

Percefit of weighted skills 
achieved (>er student 
MEAN PERCENTAGE OF 
WEIGHTED SKILLS 
ACHIEVED ACROSS STU- 
DENTS IN A SCHOOL 



Ns » 



1% 

Ns 



¥7 
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asked for a greater share in decisions that affect indi- 
vidual programs. They also said that accountability 
extends beyond cognitive achievement into the daily 
functioning of the school environment. The Glendale 
Effective Schools Model, with its dual focus on stu- 
denl achievement and school functioning, established 
a successful, faculty-based decision-making process. 
The primary vehicle for local decision making is the 
School Effectiveness Team (SET) that provides lead- 
ership at each school. 

Each SET is responsible for the annual assessment 
of school effectiveness. A local SET, typically num- 
bering about 15 persons, contains a broad representa- 
tion of teachers and administrators. Counselors, staff 
deve'iopers, clerical support staff, and one or two stu- 
dents may also participate. Teacher representatives 
are elected for a one- to two-year period. The main 
function of the SET is to assess systematically the 
performance of the school on student achievement (as 
described previously) and the eight school effective- 
ness characteristics in the GUHSD model (see Table 
1), The goal of assessment is to create an annual 
school improvement plan that addresses the strengths 
and weaknesses of faculty and staff. The school im- 
provement plan contains specific action plans and 
goals, some of which call for inservice training or 
program development. Each SET receives discretion- 
ary funds from the district in order to carry out its 
yearly goals for improvement. Since the operation of 
each SET is tied to assessment of the district's eight 
characteristics of effective schooling, the reader will 
be served by a brief overview of this assessment pro- 
cess. 

Assessment of the Eight School 
Effectiveness Characteristics 

Assessment begins with the administration of sur- 
veys to faculty, administrators, students, classified 
staff, and parents. The surveys address issues related 
to Glendale *s eight school effectiveness characteris- 
tics. Survey development encompassed a seven-month 
period, involving extensive field testing and consulta- 
tion with prominent Effective Schools researchers. 

At each school, survey administration takes two 
forms: (a) paper-and-pcncil questionnaires, and (b) 



telephone interviews. Due to costs, the telephone in- 
terviewing of parents is not conducted every year. 
Virtually the entire population of teachers, administra- 
tors, and classified staff complete the questionnaire in 
an auditorium at one sitting. Approximately 300 stu- 
dents, sampled from heterogeneous intact classrooms, 
also complete the questionnaire in the auditorium 
over a two-day period. Telephone interviews are con- 
ducted with 100 randomly selected parents. 

Shortly after administering the survey, usually at 
mid-year, the local SET receives a summary of the re- 
sults. The associate superintendent and administrator 
of research schedule a data review session with SET 
members in what is called a * 'School Effectiveness 
Institute." They introduce the data to the school team 
and model a procedure for analysis. 

The SET follows the institute with a series of plan- 
ning sessions which culminate in a school improve- 
ment plan. The school improvement plan is a school- 
based action plan for maintaining strengths or 
realizing improvements in school effectiveness. The 
action plan is tied to each of the district's eight char- 
acteristics. Table 5 illustrates one page from a typical 
school improvement plan. The plan, created by the 
SET at one high school, outlines responsibilities, ac- 
tivities, and timelines for strengthening the teaching 
of basic skills across subject areas. Tlie column la- 
beled '^Evidence of Success** is particularly impor- 
tant. It lists locally determined indicators of effective- 
ness beyond tho^ie contained in the district model. In 
this example, the action plan for the teaching of basic 
skills across disciplines is related to the seventh 
school effectiveness characteristic: emphasis on stu- 
dent attainment of essential skills. 

When formulating its school improvement plan, 
each SET obtains extensively faculty input, usually 
through a network of subcommittees. The subcommit- 
tees span job titles, inclu'^ing clerical support and 
maintenance staff for some areas of school function- 
ing. In this way, decision making becomes a vehicle 
for empowerment, enabling each school to comple- 
ment standard district policies with local autonomy. 
Figure 1 depicts a model of school decision -making, 
beginning with the dual assessment of student 
achievement and the Effective Schools characteristics 
(correlates). 
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Determine Student Outcomes 
Skills 
Competencies 
Knowledge 


\ 


Obtain Assessment Data 
Correlates of 


\ 




Effective Schooling 











Construct Action Plans 

Enhance Strengths 
Remediate Weaknesses 



Formulate Educational 
Programming into Action Plans 



Curriculum 




Instructional Delivery 




Extra-Curricular 


Content Development 




School Within a School 




Performing Arts 


Cross-Content 




Mastery Learning 




Clubs 


Instruction 


Instructional Skills 




Athletics 


Text Book Selection 




Peer Tutoring 










TESA 








Staff Development 






Professional Growth Plan 






N 








Assessment of Programming 






Evidence of Success 






Clinical Supervision 






Dropout Rate 






Absence Rate 






Norm -Referenced Test 






Criterion-Referenced Test 






Measurement Outcomes 






Measurement Correlates 
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School Effectiveness and 
Regional Accreditation 

School effectiveness assessment, with its emphasis 
on student achievement and school functioning, is an 
ideal vehicle for school evaluation by regional accred- 
iting agencies. In 1983, the district asked the North 
Central Association (NCA) for permission to replace 
the standard evaluation process with the Glendale 
Union Effective Schools model. Between 1984 and 
1987, the North Central Association evaluated all of 
the district's nine high schools, using the Glendale 
Effective Schools model. On each campus the North 
Central visitation teams spent considerable time talk- 
ing to faculty about the School Improvement Plan and 
student achievement. Team members studied school 
functioning in relation to the eight Effective Schools 
characteristics. Ultimately, the teams produced a se- 
ries of specific recommendations which were incorpo- 
rated into the School Improverf^'nt Plan. 

The focus on Effective Schools in accreditation has 
great potential for school improvement. In the Glen- 
dale Union schools, NCA evaluators were able to 
transcend the traditionally used physical data (e.g., 
number of library books, semester hours, teacher tran- 
scripts) with meaningful analysis of student achieve- 
ment and school operation. The success of GUHSD 
experience illustrates that the regional accrediting as- 
sociations can become important vehicles for the fu- 
ture expansion of school effectiveness 



Problems and Issues Encountered 
in School Effectiveness 

In the midst of a major sch^ool improvement effort, 
one stands on a higher hill than at the launching. 
From this improved lookout point, it is easy to see 
both ahead and behind— to confirm and celebrate 
some decisions; to regret, correct, and move beyond 
others. As practitioners do this, their reflections 
should have practical value to others. These final 
comments may help to guide other educators through 
the crucial early stages of implementation. 



Looking Back 

• No single resource has served Glendale Union's 
work in Effective Schools better than its mature 
program of valid and reliable criterion-referenced 
testing in core subjects. Good measures of student 
achievement are irreplaceable in an effort to docu- 
ment school improvement. 
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♦ No single decision has done more to enhance the 
professional climate of the district than the em- 
powerment of local staff through school effective- 
ness teams. As school teams were given budgets of 
up to $5,000 for the achievement of school im- 
provement goals, their decision making carried 
even more meaning. 

♦ The introduction of school effectiveness teams into 
a system in which other leadership groups were 
functioning created some role ambiguity that 
should have been clarified. With the introduction 
of an Effective Schools plan, the span of authority 
of a school's various advisory committees should 
have been established. 

♦ Because strong administrative leadership is vital to 
the entire school, it is especially important that a 
school effectiveness team maintain sharp focus on 
school management goals and translate goals into 
meaningful action. Maintaining team focus and 
limiting the activity of the team to assure high 
quality maximum input is a significant, continuous 
challenge to the principal and local leaders. 

♦ A school's decision to focus on a few goals at one 
time, rather than work across the spectrum of Ef- 
fective Schools issues, helps staff members de- 
velop understanding and commitment to key con- 
cepts. 

♦ It is vital to school improvement that the Effective 
Schools plan be integrated into the deep structure 
of the school system. It cannot be managed as a 
"new program,'* hanging like an appendage to the 
main business of the school district. It must be- 
come »he main business of the district. 

♦ The decision to marry the district's work in school 
effectiveness with periodic assessment and evalua- 
tion by the regional accrediting association is an 
excellent method of (a) testing and improving dis- 
trict methodology through external review, (b) lim- 
iting the considerable work required of staff, (c) 
securing wide staff participation in the Effective 
Schools process and giving it tangible form. 

Looking Ahead 

With six high schools in the City of Phoenix and 
three in suburban Glendale, the Glendale Union Dis- 
trict will experience dramatic population changes in 
some schools within the next ten years. The increas- 
ing urbanization of some communities within the dis- 
trict will call upon a strong belief system and tested 
methodology if schools are to continue to function at 
established high levels. Looking ahead together, dis- 
trict teachers and administrators see this challenge 
and share a commitment to deepen the culture of Ef- 
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fective Schools now — before significant changes in 
target populations occur. 
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Geary County, Kansas School District 

Became involved in Effective Schools process in 1985 



Community 

Population 

20,000 in Junction City 
20,000 Fort Riley 

iJOO Grandvlew 

1 ,082 Milford 

50 percent qualify for 
free-and-reduced price lunch 

Junction City is in the middle of 
an agricultural area, yet is 
somewhat cosmopolitan due to 
the diverse population of Fort 
Riley. Because the U.S. 
government is the largest land 
owner. Geary County has one 
of the lowest assessed 
valuations in Kansas. Geary 
County has the highest birth 
and divorce rates, and the 
greatest rate of child abuse. 
The major employers are the 
United Telephone Company, 
the Geary County School 
District, and a few small 
industries. In general, 
demographic factors, including 
high mobility, high levels of 
poverty, and cultural diversity 
combine to increase the school 
distri<:t's concern with students 
at-risk. 



School District 



Enrollment 

7,000 

Ethnic Composition (percent) 

33.1 
.3 
4.8 
54.6 
7.2 



African- American 
American Indian 
Asian-American 
Caucasian 
Hispanic 



Per Pupil Expenditure 

1987-1988 $2,964.94 
(general fund operating 
budget— capital outlay 
budget not included) 



Percent bussed 

17 



Areo (in square miles) 

262 

Schools 

Elementary schools (K-6)13 
Junior high schools 2 
High schools (10-12) 1 
Other (alternative) 1 



Number of Staff 

Administrators 31 

Certified teachers 464 

Support staff 386 

Student-Teacher Ratio 

Elementary 25:1 

Junior high 17:1 

High school 16:1 

Percent college-bound 

65 



Abstract 



A tersely written case study, Geary County's 
report reflects the superintendent's, board of 
education's, and staff's firm intentions to run a 
solid organization. The setting of priorities, test- 
ing, and reports to all constituencies of informa- 
tion gathered in j systematic way has been the 
nature of change for Geary County from the 
beginning of its school improvement program. 
The superintendent believes quality, frequent 
communication, and shared decision-making 
are the primary factors in effective implementa- 
tion of the program. 

Attention is paid to ongoing staff develop- 
ment through Mid-continent Regional Education 



Laboratory (McREL) training and central office 
support through the Assistant Superintendent for 
Instruction and the Liaison for Effective Schools. 
Buildings take responsibility for determining their 
own staff development needs, and the results 
of these individual programs are shared be- 
tween building staffs at the beginning of each 
year, along with other information that is perti- 
nent to the school improvement effort. The col- 
laborative, continuous staff development pro- 
gram is described in depth, with information on 
both content and process. 
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Brief Overview of the Effective 
Schools Program 

Junction City, Kansas, with a population of ap- 
proximately 20,000, is the principal city and county 
seat of Geary County. Nearby, Fort Riley, a military 
installation, has approximately 20,000 more inhabi- 
tants. The district is located 130 miles west of Kansas 
City. The nearly 7,000 students include those who re- 
side on the Fort Riley Army Base, as well as resi- 
dents of the community and surrounding rural areas. 

Students represent multi-cultural backgrounds. The 
influence of active and retired military members of 
the community contributes to the global perspective 
of both siL jents and patrons in the district. However, 
for many years, that same mobility was thought to be 
one of several excuses used to justify low student 
achievement. Fortunately, becoming involved in the 
Effective Schools process has emphasized instruc- 
tional elements over which educators have control. 

The district demographics are more descriptive of 
an urban setting than might be expected in rural Kan- 
sas. Over 50 percent of the students qualify for free- 
and-reduced price lunches, the district is poor in 
terms of assessed valuation and income, and 42 per- 
cent of the students are minority. 

The Geary County School District first became 
aware of the Effective Schools process after Betty 
Kline, director of elementary education, attended an 
Effective Schools Conference with Larry Lezotte in 
Phoenix in January 1985. She insisted that others 
should be informed. In the summer of 1985 ten repre- 
sentatives of the district attended the Ron Edmonds 
Effective Schools Institute in East Lansing, Michigan. 
Those accompanying Superintendent Max O. Heim 
included three central office personnel, three building 
administrators, and three teacher leaders of the local 
NEA affiliate. One teacher, Pat Anderson, became the 
district's first liaison for Effective Schools in January 
of 1986. This group decided that the new knowledge 
available through Effective Schools Research was so 
exciting that more sharing should take place. Accord- 
ingly, Dr. Lezotte came to the district in August 1985 
to explain the research and the process to another 
group of staff and to the members of the USD #475 
Board of Education. 

The commitment of the Board of Education came 
swiftly. The board authorized an agreement with the 
Mid-continent Regional Education Laboratory 
(McREL) in Kansas City, Missouri, a federally 
funded project which provides training and support to 
local districts in a seven-state area. For approximately 
$20,000, McREL agreed to train a pnel of teachers 
from each of the district's sixteen buildings and to 
provide special sessions for administrators. Each 



month, from February through May of 1986, building 
panels, each including the principal, met for one full 
day of training with Susan Everson. McREL*s request 
to limit participants to no more than 50 each day ne- 
cessitated having two days of training back to back. 
Half-day administrative sessions preceded two panel 
days each month. Substitutes were secured for all 
teachers, an additional financial resource which dem- 
onstrated the commitment of the board of education. 

The Geary County Board of Education substan- 
tially increased financial support as needs developed 
during and immediately after the McREL training of 
building panels. Teacher visits to Effective Schools in 
other districts helped to address doubts and fears 
about the change process and to verify positive out- 
comes. The board of education encouraged staff visits 
to Effective Schools in St. Louis, Missouri; East 
Cleveland, Ohio; Norfolk, Virginia; and Glendale, Ar- 
izona. All principals and their assistants were sent to 
an Effective Schools conference featuring Larry 
Lezotte in either Michigan or Arizona. The superin- 
tendent began to devote a regular portion of each 
monthly board of education meeting to reports, usu- 
ally presented by teachers, about the Effective 
Schools process and specific instructional strategies. 
Dr. David Flowers, assistant superintendent for in- 
struction, coordinated these informative presentations 
and provided district leadership in current staff devel- 
opment practices. 

Commitments made by the board of education to 
fund necessary expenditures from the district budget 
were coupled with the support of building principals 
to plan more time for the staff to identify problems 
and collaborate in seeking solutions. Each building 
defined its own mission statement, and then set about 
scheduling time and resources with priorities stated in 
the district's mission. 



Evidence That District 
Schools Are Improving 

The primary monitoring process used to track 
students' academic achievement is the California 
Achievement Test (CAT) Form E/F, 1987, and the 
Kansas Minimum Competency Test, which is a crite- 
rion-referenced test administered by the state in read- 
ing and mathematics to all students in grades 2, 4, 6, 
8, and 10. The intent in the district*s achievement 
monitoring system is to assess quality and equity. At 
the same time, the district is moving forward with the 
development of criterion-referenced tests based upon 
locally determined teaching objectives. Curricular 
alignment has been accomplished in reading and 
mathematics. 
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Table 1 




CAT Math and Reading: 




Cbmbined Qriidee K-€. 




Percent of aludenu acoririo 


at or above ttie S4Mh p 


Math 


Reading 


• -%..;.;■• 




Boys 63*6 


53.0 


Girls ■ 64.2 


56.2 


Free Lunch 54.2 


46.3 


Reduced Lunch 62.2 


52.5 


Paid Lunch 70.0 


60.8 


White 68.7 


61.6 


Black 53.5 


45.6 


Hispanic 67.5 


53.8 


Asian 81.4 


62.4 



The revis<*.d, new edition of the California 
Achievement Test was administered in the spring of 
1986-87. In this initial year the district piloted the 
test and analyzed it primarily on the basis of quality. 
During the second year, in the spring of 1987-88, the 
test was administered again and baseline data were 
established for a disaggregated analysis based on gen- 
der, race, and income. The criterion used to judge 
family income was whether the student participated in 
the free-and-reduced price lunch programs. Attempted 
use of the mother's level of education yielded unreli- 
able disaggregated results due to inaccurate or reluc- 
tant reporting, particularly at the secondary level. 



Table 1 shows the total mathematics and total 
reading scores for the elementary grades. Each year 
the test results will be examined for evidence of im- 
provement. The base-line data on the CAT indicate a 
clear gap between certain groups. The ongoing schooi 
improvement/Effective Schools process will focus on 
reducing these gaps. The good news is that in many 
instances even the traditionally lower achieving 
groups are at or above the 50th percentile on this 
norm-referenced test. 

Students who took the second monitoring instru- 
ment, the Kansas Minimum Competency Test 
(KMCT), have shown dramatic improvements in 
achievement over the two years since the Effective 
Schools process was implemented in Geary County. 
The KMCT covers from 15 to 20 objectives in read- 
ing, and 15 to 20 objectives in mathematics, in grades 
2, 4, 6, 8 and 10. The test has been given in Kansas 
each year since 1980, with the exception of 1983. 
Geary County Schools used to do rather poorly on the 
test. Although the stated intent of the test is to pro- 
vide individual student data to districts so teachers 
can design remediation, each year the test has been 
the focus of considerable media attention. Districts 
are compared to one another. Geary County generally 
came up short compared to nearby districts and the 
state overall. 

In the fall of 1986-87 each building designed an 
improvement plan to address achievement on the 
KMCT. Teachers were asked to help increase 
achievement on the KMCT and to monitor equity 
using a disaggregated analysis of the results. Princi- 
pals monitored achievement on the KMCT objectives 
over the course of the year. A state practice test was 
administered in January each year before the actual 
test in March. The following graphs indicate dramatic 
improvement over a two-year period in reading and 
mathematics. Table 2 reports the actual percentages 
represented in the graphs. 



Table 2 

1986/1937/1988/1989 KMCT Achievement Results. 



Percent that met or exceeded ataiidard 



Gradea 



8 



10 





B 


M 


R 


M ■■' 


V R : 


M 


R 


M 


R 


M 


1989 


93.5 


95.0 


95.0 


94.8 


86.5 


93.7 


98.5 


68.5 


75.8 


63.5 


1988 


98.4 


99.5; 


91.6 


97.7 


87.9 


93.6 


89.6 


74.3 


82.9 


55.8 


1987 


97.3 


98.2 


86.5 


gi;9 


gao 


94.3 


81.0 


68.8 


85.1 


60.6 


1986 


81.3 


93.5 


71.5 


72.1 


74.7 


77:8 


79.2 


58.9 


77.2 


66.0 
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1987 District kMCT Oi«a^^^ 


Grades 


2 












■i -.10 '■ 


Totals 




R 


M 










•■'■R'-'"ii." 


R M 


Total taking test 


617 


617 


1509 


• 511 --^y 441 437 


388 


1 38 ■ 


3^ 36 


2320 2317 


Total taking test 
whose mother 
has leiss than H.S. 
diploma 


79 


79 


61 


61 64 64 




51 


27 25 


282 280 


Percent passing 


91 


100 


84 


90 91 92 


67 


51 


89 44 


85 82 



The KMCT results were also analyzed for equity 
after the first year using the mother's level of educa- 
tion. Table 3 shows the percentages of students pass- 
ing the test whose mother had less than a high school 
diploma, compared to percentages passing the test 
from families in which the mother had a high school 
diploma or some college-. These data indicate a rela- 
tively equitable distribution of achievement at the ele- 
mentary level, and relatively high quality as well. At 
the secondary level the percentage of students passing 
the test was lower than desired. The important news 
is that a significant improvement in achievement 
seemed to be a direct result of the Effective Schools 
process. 

Disaggregated results of the California Achieve- 
ment Test (Forms E and F) for 1988 and 1989 illus- 
trate one way in which the district monitors equity. 
The data in Table 4 clearly show a gap in the per- 
centage of students from low socio-economic status 
families, and those from high SES families, in terms 
of the percentage of students scoring above the 50th 
percentile on the Total Battery score. For example, in 
2nd grade in 1988, 52.3 percent of the students on 
free and reduced-price lunches scored above the 50th 
percentile, compared to 70.9 percent of the students 
who pay for their lunches. This is evidence of a lack 
of equity in achievement among students based on 
family income. What the district wants to see, how- 
ever, is improvement over time as a result of the Ef- 
fective Schools process. There is evidence of such 
improvement when we see a higher percentage of the 



students from low SES backgrounds scoring above 
the 50th percentile from one year to the next. This 
occurred between 1988 and 1989 in grades 2, 3, 4, 5, 
8, and 12. There were declines in 6, 9, 10, and 11. 
The district will monitor this type of data each year to 
track progress in narrowing discrepancies between 
sub-populations. 

An additional way that equity is monitored is to 
compare the percentage of students from a given sub- 
population, such as males, to the percentage of the 
total population represented by that subgroup in cer- 
tain score ranges. The district has only begun to dis- 
aggregate data based on this method, thus the infor- 
mation in Table 5 represents baseline data. Where 
there are discrepancies, the district will look for im- 
provements in subsequent years. For example. Table 5 
demonstrates that there are not large gaps between the 
percentage of males and females in the total popula- 
tion, and the percentages that these sub-populations 
contribute to the scores above the 50th percentile. On 
the other hand, we see clear evidence of inequity in 
the ethnic data. For example, we note that 34.1 per- 
cent of the 4th graders are black, but only 27.7 per- 
cent of the students who scored above the 50th per- 
centile were black. This pattern of inequity is 
repeated throughout the California Achievement Test 
results, and thus bccom_es a district-wide target for 
improvement. In subsequent years the district will ex- 
pect the percentage of blacks scoring above the 50th 
percentile to be more in line with the percentage of 
blacks in the total population. 
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TtibiB 4 

Percent scoring aixyve SOth percentile on CAT Total Battery 





LowSES 
1988 1989 


HighSES 
1988 1989 


2 ' . . 


52.3 


55.7 


70.9 


66.8 


■ 3 


■■ 44.5 ^ 


51.6 


65.7 


59.4 


4 


45.3 


51.0 


62.7 


67.1 




40,1 


47.0 


60.5 


62.7 


■■."6 


52.2 : 


45.5 ■ .■ ■■ 


60.4 


65.0 


7 


■ 4S.3 


40.1 


55.5 


61.4 


8 


31.5 


35.8 


,^ 60.6 


53.8 


■•■■9 ■ 


.;:-36,4----- 


;r34iO-->"V;.- 


52.9 


65.2 


10 


40.2 


33.3 


48.4 


51.5 


11 


45.7 


36.7 


56.2 


47.5 


12 


31.3 


37.3 


57,2 


54.0 



How the Effective Schools Process 
Influences Program Components 

The Effective Schools process has been influential 
in focusing the curriculum on student outcomes and 
in reinforcing the need for a positive and professional 
climate for staff. The superintendent's goal to raise 
district test scores on the Kansas Minimum Compe- 
tency Test (KMCT) quickly generated critical ques- 
tions about the match between teaching and testing. 
Individual building plans included frequent monitor- 
ing of student progress, careful selection and design 
of materials to support the curriculum, and the in- 
creased sharing of successful teaching strategies 
among the stafL As test scores have improved, more 
teachers have come to enjoy their crucial role in for- 
mulating and teaching the intended curriculum. 

The sense of empowerment is also stimulated by 
opportunities of staff at all levels to promote benefi- 
cial change. Pilot projects such as class- wide peer-tu- 
toring, the whole language approach to reading and 
language arts, and an integrated library program have 
produced such successful results that teachers are be- 
coming more enthusiastic and therefore more commit- 
ted to the process each year. 

Sharing these new efforts with visitors from other 
districts has strengthened the resolve of administrators 
and staff and led to more risk-taking and less fear of 
failure. News media in the community have provided 
information about school improvement activities in a 
positive and informative manner. The media have no 
doubt increased community interest and participation 
in the program of the district's schools. A recent ex- 



ample was the excellent coverage of parent-teachcr- 
student conferences held for the first time prior to the 
start of school in the district's three secondary build- 
ings. 

How the Effective Schools Process Is 
Affecting Measurement of Student Data 

Disaggregation of data somcti'nes confirms what 
has been feared. At other times it provides important 
information which could not have been anticipated 
apart from such analysis. For example, one elemen- 
tary building noted that an unusually large percentage 
of students who fared poorly on the KMCT came 
from single-parent homes. Armed with those data, 
teachers sought help from research and experts in an 
effort to increase instructional effectiveness with 
these students from single-parent homes. 

Another natural direction for measuring student 
data as part of the Effective Schools success is the 
development of criterion-referenced tests. Starting at 
the senior high level in the core subjects, teachers are 
identifying the essentia] outcomes in terms of student 
behaviors for particular classes and grade levels. 

Changes in Staff Development Programs 

The discrepancy model, which McREL encouraged 
as a basis for the school improvement process, exam- 
ined current district practices and outcomes in a par- 
ticular area, considering preferred outcomes and ex- 
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amining the research to learn what practices might 
bring about the more desired outcomes. 

This model has been applied also to district staff 
development. Prior to involvement in the Effective 
Schools process, staff development had consisted pri- 
marily of four days planned at the district level. 
Building staffs now take responsibility for determin- 
ing their own needs and conducting three and one- 
half day development activities. The half day remain- 
ing on the calendar is used to begin the year with 
sharing information that is important to all district 
employees, information on AIDS, for example. The 
purpose of staff development at the district level is to 
provide research-based study to support individual 
needs. Because the district participates in the State In- 
service Plan, teachers can recertify by participating in 
local staff development. The Geary County Board of 
Education also recognizes this recertification in deter- 
mining teacher movement on the salary schedule. 
State and local support, along with a variety of re- 
search-based opportunities such as TESA, Thinking 
Skills, Class-wide Peer Tutoring, Cooperative Learn- 
ing and Student Team Learning, have created a new 
awareness that staff development opportunities can 
lead to greater teacher efficacy. 

The shift to building-based inservice programs en- 
sures a more systematic, ongoing rather than a one- 
shot approach, to 'itaff development. Building activi- 
ties are linked directly to the school improvement 
plan of each site. Pat Anderson, as liaison for Effec- 
tive Schools, encouraged consistency in the program 
by serving as a resource person for Effective Schools 
panels. Panel members draw from both formal and in- 
formal needs assessments in designing their school 
improvement plans and supportive inservice. Teachers 
also serve as the trainers for these programs. 

Because training in Effective Schools Research and 
practice could not be provided to all staff initially, 
and because out-of-district conferences and school 
visitations could not include all teachers, a special 
staff development program was arranged during the 
spring semester of 1988. Thirty-five teachers, each 
representing a building, were invited to spend a day a 
month during February, March, and April attending 
the **Acadcmy for Excellence.*' Organized by Pat 
Anderson, teachers were provided substitutes and 
spent each of the three days in comfortable meeting 
space offered by the local telephone company. Out- 
standing presenters included two University of Kansas 
professors, Drs. Nona Tollefson and Fred Rodriguez, 
Susan Everson of McREL, and several district teach- 
ers. The original 35 participants were so appreciative 
of this opportunity that these sessions will be contin- 
ued. 
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Components of the Planning Process 

The district level team which first attended the Ef- 
fective Schools Conference with Larry Lezotte in 
1985 was essentially disbanded after the decision was 
made to launch the school improvement process uti- 
lizing McREL as trainers for the district. In its place, 
each building Effective Schools panel has taken an 
important leadership role in planning and implementa- 
tion of the Effective Schools process. Superintendent 
Heim and other central office staff have remained in- 
formed and supportive of differing needs and varied 
pacing while setting clear expectations for improve- 
ment. 



Personnel Evaluation System Changes 

As a result of the district's involvement with the 
Effective Schools process, emphasis in evaluating 
building administrators has moved beyond manage- 
ment functions to instructional leadership. Dr. 
Lezotte's words are significant with respect to person- 
nel evaluationv **What gets measured, gets done." 



Developments Related to the 
Effective Schools Process 

The goals of the Instructional Division, now in- 
cluded as board of education policy, are also the cor- 
relates of Effective Schools. All instructional division 
activities support one of these targets. 

The Effective Schools process has also generated a 
district slogan, decided upon by parents and school 
district staff. Every employee of the district has re- 
ceived a pin which conveys commitment and confi- 
dence in the words, **We Believe All Can Achieve.** 
These words are included along with the Unified 
School District #475 logo on district documents and 
communications. 

Visits to other districts have yielded important and 
useful ideas for consideration by the Geary County 
district. The position of instructional coordinator in 
the elementary school is one example. Four district 
elementary buildings are now served by a teacher 
who works full-time to assist the instructional im- 
provement process under the guidance of the building 
principal. Long range plans call for the addition of 
this support role in all buildings, since the district and 
teachers believe this position is essential. 

The Effective Schools process has focused atten- 
tion upon the need for recognition and involvement of 
all staff. Accordingly, all district employees arc eligi- 
ble to receive The Shining Star Award, recognition 
presented quarterly to outstanding individuals. Also, 
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Superintendent Heim's emphasis on shared decis'on- 
making has been recognized throughout the state. 
Communications across the district are notably better 
because of the increased involvement of teachers and 
principals in deciding major issues pertaining to cur- 
riculum and instruction. 



Concerns Related to the 
Effective Schools Process 

Two concerns surfaced early in the process. The 
first concern was that emphasis on successful mastery 
of basic skills for all students would penalize faster 
learners. Test scores have revealed that concern to be 
groundless. Faster learners have improved along with 
those who need more time. 

The second concern was how to find enough staff 
time to plan and prioritize tasks for doing the job 
right. The administration eliminated all weekly dis- 
trict meetings after school, thereby enabling building- 
level staff to hold meetings that day. Finding enough 
time will require constant monitoring and a large 
measure of creativity. 

Advice to Other Districts 

In retrospect, more widespread understanding of 
the change process would have helped. More staff 
should have been exposed to the process and should 
have discussed how they might be affected. The read- 
iness phase was given too little attention. 

Instead, the training provided by McREL focused 
primarily upon effective instruction, and although 
many teachers were excited about opportunities to ex- 
amine research and to try new strategies, some ques- 
tioned the need to alter long-standing practices. Spe- 
cifically some wondered why willingness to behave 
differently appeared to identify them at once as being 
the problem and the solution. Addressing change as 
a separate issue would have emphasized future em- 
powerment rather than delineating any past lack 
of awareness. The effective teaching research pre- 
sented about instruction was appropriate content, but 
the process of change should have been provided as 
the principal framework for implementation. [Editois 
note: In the National Center's model, emphasis is 
placed on school/site restructuring, district planning 
and coordination, and team building skills before 
most of the effective teaching skills are addressed.] 

The fact that more staff did not resist the Effective 
Schools process largely has to do with the outstanding 
teachers who were included in the initial training. 

ERIC 



Many were entirely comfortable in pursuing new 
strategies on their own. For example, some rethought 
their grouping practices and restructured their class- 
rooms. Groups, as well as individuals, became in- 
volved in rethinking previous practices. One panel 
considered the research on beginning the school year 
more effectively. To accomplish this, several mem- 
bers elected to conduct summer parent-teacher confer- 
ences with their new families as soon as student en- 
rollment had been completed. The fact that no 
mandates were issued by McREL or by principals en- 
hanced many teachers' willingness to take risks. Cer- 
tainly the necessity to allow for voluntary modifica- 
tions was important with or without formal study of 
change, but perhaps more staff would have been will- 
ing to take risks earlier had they shared common in- 
sights into this rather stressful, but rewarding, oppor- 
tunity. 

Summary 

Because the school improvement process is site- 
based, many of those whom James Lewis has referred 
to as **champions" have emerged in the district. 
Without being able to identify everyone, individuals 
representing particular segments of the organization 
deserve mention. Dr. Mary Devin, Deputy Superinten- 
dent, used her financial expertise and support of the 
Effective Schools process to provide the necessary 
budgetary resources to launch and continue the pro- 
cess. Teachers such as Nancy Hubbard, Jan McNeese, 
and Shelley Buchanan represent the many elementary 
staff who heard that reading groups were not the only 
useful strategy for teaching reading and designed a 
new classroom for their students. Lee Sharpe and Dr. 
Hazel Swarts are characteristic of district elementary 
principals who have dedicated their efforts to provid- 
ing building climates conducive to teaching and learn- 
ing. Dr. Larry Dixon, principal of Junction City Se- 
nior High School, exemplifies a secondary 
administrator whose enthusiasm for his staff and 
whose desire for success for students and teachers 
alike is unceasing. 

Leadership at every level is crucial for success of 
the Effective Schools process. The superintendent's 
leadership is most critical. In this district clear goals 
have been shared, but dictates have been avoided. 
Trust is both the foundation and the by-product of the 
Effective Schools process. Empowerment, pride, and 
success are the governing goajs for school improve- 
ment for all who come to teach and to learn in Geary 
County Unified Schools. 
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East Detroit School District 

Became Involved in Effective Sclnools process In 1983 


Comnnunitv- 


School District 


Population 

35,120 


Enrollment 

7,276 


Area (In square miles) 

4 plus 


East Detroit, a city located In 
southeastern Michigan, was 
founded in 1830 by European 
Immigrants. Though once a 
fairly affluent community, the 
population today is 
predominantly biue-collar, 85 
percent middle class, 15 
percent poor. The average 
income per capita is $11,726, 
slightly above the state 
average. Over the past 20 years 
the student population has 
decreased substantially. 


Ethnic Composition (percent) 

Caucaskan 98 
Other 2 

Per Pupil Expenditure 

1987- 1988 $3,718 

1988- 1989 3,614 


Schools 

Elementary schools 8 
Junior high schools 2 
High school 1 

Number of Staff 

Administrators 28 
Certified teachers 245 
Support staff 31 

Student-Teacher Ratio 

Elemenlary 27:1 
Junior high 27.1 
High school 23:1 


Somewhat under half of East 
Detroit's residents, 16,500, are 
employed. Forty-four 
manufacturing firms, 41 
wholesale firms, 281 retailers, 
and 281 service industries are 
located in East Detroit. A 
substantial number of other 
residents commute to nearby 
communities or work for the 
school system or the city. 


Percent bussed 

0 (except for special ed) 


Percent college-bound 

31 




Abstract 




East Detroit started (1983-85) with a pilot cyclical planning process at the district level, 
school and then expanded the Effective These systems are succinctly delineated in the 
Schools process to the entire district in 1985. Al- following chapter. The process of setting up 
though this district has only recently begun to these mechanisms and making them operate 
see student standardized achievement scores to the satisfaction of the staff is described in 
Increase at certain grade levels, it is building a several phases of development. Finally, the on- 
solid foundation for future accomplishment. Stu- going good relationship with the community of 
dent achievement scores are expected to con- East Detroit produces increased millages in the 
tinue to Increase significantly in the next two tax base for schools and support for further 
years. school improvement. 


Curricular alignment and development and 
staff development are being integrated into a 
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Brief Overview of the Effective 
Schools Program in East Detroit 

East Detroit, a suburban community of approxi- 
mately four square miles bordering the city of Detroit, 
is a bedroom community that has few industries or 
commercial enterprises to increase the tax base. Little 
space is available for building new homes. Approxi- 
mately 38,000 predominantly white, English speaking 
people jive in East Detroit, Tne average education 
level of the adult residents is eleventh grade, with a 
population of approximately 85 percent middle class 
and 15 percent poor. ^ 

The public school enrollment in East Detroit has 
decreased from a high of 13,700 in the late 1960s to 
the current enrollment of 6,6»00. The school district 
now operates eight elementary schools, two junior 
high schools, and one high school. Three elementary 
schools and one junior nigh school were closed in the 
last decade. During this time the adult education en- 
rollment has increased from 40 students to 600 stu- 
dents, bringing district enrollment up to 7,200 stu- 
dents. 

Approximately 31 percent of the graduates of the 
East Detroit schools seek additional training at a two- 
or four-year college. The remaining 69 percent at- 
tempt to enter the job market, join the armed forces, 
or get married. 

Educational research and Effective Schools litera- 
ture suggest that improvements can be made even in 
the best of schools. Though administrators and teach- 
ers in the East Detroit public schools believe the sys- 
tem does a good job, they have always looked for 
ways to improve the instructional program to meet the 
changing needs of students and society. 

In the early 1980s in response to nation-wide criti- 
cism of schools and in recognition that self-evaluation 
needs to be continuous, school leaders began to ex- 
amine the literature on excellence in schools. The Ef- 
fective Schools literature suggests that certain educa- 
tional practices work better than others in developing 
a positive climate in schools, and that specific instruc- 
tional practices can improve student successes. The 
literature also suggests that a normal curve need not 
be the standard of effectiveness. Ideas such as these 
motivated the leadership to introduce Effective 
Schools concepts to the administrative team. 

Beginning in 1984-85 one elementary school pi- 
loted the Effective Schools process for two years as a 
iesult of principal and staff interest in the concept. 
The program focused on improving instruction 
through mastery learning. The staff of this pilot 
school found the process was very effective. This led 
to a district-wide effort to involve all schools. 



In the spring of 1985 the assistant superintendent 
of instruction talked with the principals about the 
school improvement process, distributed literature, 
and discussed implementation. With the support of 
the principals, the board of education was informed of 
the program at a special session. The assistant super- 
intendent also met with the president and chief nego- 
tiator of the teachers* union who subsequently en- 
dorsed the concept. 

Key leaders in the Effective Schools program in 
East Detroit included the assistant superintendent of 
instruction and the building principals who were pri- 
marily responsible for developing and implementing 
the district plan. Dr. Lawrence Lezotte from Michigan 
State University provided the necessary consulting 
services. Other leaders included curriculum coordina- 
tors, volunteer teachers, union leaders, board of edu- 
cation members, and parents. The district Effective 
Schools/School Improvement Committee of 47 mem- 
bers developed the district plan. A steering committee 
of 20 members provided direction for the district 
committee. 

The Effective Schools program in East Detroit has 
been funded with local funds, ECIA Chapter 2 funds, 
and state level Section 97 Professional Development 
funds. The latter, administered by a local staff devel- 
opment team, had support of the district school im- 
provement plan as one of its objectives. Workshops 
that support the instructional process have included 
the Madeline Hunter model. Cooperative Learning, 
Mastery Learning, and Reality Therapy. 

In addition to those Effective School projects spon- 
sored at the district level, each school received $2,000 
annually to support the work of the building improve- 
ment teams. In addition, during the first two years of 
the program, district funds supported half-day work- 
shops for the building teams to meet with Dr. Lezotte. 
During these workshops, building teams read and dis- 
cussed tiie literature on Effective Schools, gathered 
and examin'id data, and developed plans for meeting 
the needs of their individual buildings. These meet- 
ings were held during the school day at the elemen- 
tary level and after school for the secondary and adult 
education levels. 

During the second year of the program, teachers 
were paid a stipend of $400 to attend 15 days of 
workshops that focused on Outcome Based Instruction 
and the effective instruction characteristics of Effec- 
tive Schools. The total cost of this program was 
$24,000. Eleven of the workshop days occurred dur- 
ing the summer and four were held in the evening or 
on Saturdays. Funding was also provided for staff 
from Johnson City Central Schools, Johnson City, 
New York, to be trainers at these workshops. 
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Building level teams of teachers and administrators 
visited outstanding school programs. Teams from four 
schools visited and observed Johnson City Central 
Schools. Two other teams visited the Glendale, Ari- 
zona program and one team attended a conference on 
Effective Schools and School Improvement in Glen- 
dale, Arizona. Such visitations provided staff mem- 
bers with valuable information and insights about 
how to develop a building level plan for Effective 
Schools and school improvement. 

During this time, the East Detroit Public Schools 
also invested $6,800 of Chapter 2 Block Grant funds 
in teacher training for the Madeline Hunter approach 
to instruction and to send staff members to training 
that was offered by the Intermediate School District. 
Approximately 1/3 of the staff has participated in the 
Instructional Theory Into Practice (ITIP) workshops 
held during school, after school, or on Saturdays. 
Teachers were given the opportunity to participate in 
the workshops at a time that was convenient for them. 
At the same time, administrators participated in the 
mP and clinical supervision workshops. These strate- 
gies for instruction are believed to be consistent with 
the Effective Schools Research and supportive of the 
total school improvement program. 

The East Detroit Public Schools has always sup- 
ported staff development and professional growth ex- 
periences for administrators and staff members. In ad- 
dition to support through funding, the Effective 
Schools/School Improvement Program has been sup- 
ported symbolically by a leadership team that encour- 
ages attendance at professional conferences, work- 
shops, curriculum development meetings, and 
visitations. Strong central administrative support, 
strong building-level administration support, along 
with board of education and parental support, have 
been important to the planning, implementation, and 
evaluation of the school improvement program. 



What Evidence Does the District Have 
That the Schools are improving? 

As a result of the district involvement in the Effec- 
tive Schools/School Improvement Program, teachers 
are expressing greater interest in developing a data- 
based instructional program. The purpose of gathering 
data on student achievement and specific outcomes is 
to assess whether improvement is taking place. Ad- 
ministration and staff believe that **all children can 
learn," and no longer accept the normal curve as a 
standard of effectiveness. As a result, there is a need 
to gather data to determine if all children are realizing 
quantitatively more success in school. 
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In the past, assessment tests were used to prt vide 
staff members with information about student 
achievement. While district data were gathered, no 
coordinated effort had been made to develop baseline 
data nor to examine growth over a period of time. As 
a result of the Effective Schools/School Improvement 
Program, an effort is now being made to develop dis- 
trict and building baseline data to provide information 
regarding improvement in student achievement over 
time. 

Traditionally, norm -referenced assessment tests 
have been used in the East Detroit schools to provide 
data on the achievement of the students in East De- 
troit as compared to students throughout the United 
Slates. In general, students in East Detroit have per- 
formed at or slightly above the normal distribution or 
curve. The IOWA Test of Basic Skills has been used 
to determine growth at the third, fifth, and eighth 
grade levels. The Gates-MacGinitie Reading Test has 
been used to assess general reading ability for stu- 
dents in grades six through ten. 

Presently, baseline data are being gathered for all 
of the testing programs. While slight but steady prog- 
ress is seen in some areas, student performance in 
general has been stable. As the curriculum in all of 
the schools is revised, and as staff development and 
school improvement programs are implemented, it is 
expected that student achievement will improve. At 
this time, the direct influence on curriculum and in- 
structional practices is just beginning. 

The Michigan Educational Assessment Program 
(MEAP), a criterion-referenced test, currently assesses 
achievement in reading and mathematics. Baseline 
data on the performance on the MEAP reading test 
shows that results are stable with 81.2 percent of 
fourth grade students performing in the fourth quartile 
in 1987. This is a small improvement from 80.6 per- 
cent in 1986 and 81.6 percent in 1985. Greater im- 
provement has been seen at the seventh grade level 
with 86.2 percent of students performing in the fourth 
quartile in 1987, an increase from 82.4 percent in 

1986 and 79.8 percent in 1985. At the tenth grade 
level, a slight decline in performance was seen in 

1987 with 79 percent of students performing in the 
fourth quartile, a decrease from 82.4 percent in 1986 
and 81.9 percent in 1985. 

In the area of mathematics, 89.4 percent of fourth 
grade students performed in the fourth quartile, a 
slight increase from 88.4 percent in 1986 and 85.9 
percent in 1985. At the seventh grade level, 79.8 per- 
cent of students performed in the fourth quartile, a 
significant increase over the 71.3 percent in 1986 and 
64 percent in 1985. At the tenth grade level, scores 
again increased from 76.1 percent of students per- 
forming in the fourth quartile in 1987, an increase 



from 70.1 percent in 1986 and 66.6 percent in 1985. 
While these scores may appear to be low, it is inter- 
esting to note that they are above the state and county 
averages at the 4th grade level, and well above the 
state and county levels for 1987 in grades seven and 
ten. 

The computer management programs for both read- 
ing and mathematics basal programs have enhanced 
the district's ability to examine student progress more 
specifically in the reading and mathematics curricu- 
lum. Students in grades 3 through 6 use the computer 
management programs when taking unit and summary 
tests. 

After two years of using the computer management 
program that accompanies the basal reading program, 
baseline data reveal that students are mastering an av- 
erage of 84 percent or more of the reading objectives 
district-wide. At one elementary school, third and 
fourth graders who are using a mastery learning ap- 
proach to reading instruction have mastered an aver- 
age of 96 percent of the reading objectives. Fifth and 
sixth grade students in the same school but not ex- 
posed to the mastery approach averaged 83 percent. 
Though there may not be any direct causal relation- 
ship, it will be interesting to observe whether the out- 
standing performance of the current third and fourth 
grade students continues. 

In mathematics, the data show that an average of 
85.5 percent of third grade students, 81.5 percent of 
fourth grade students, 74.7 percent of fifth grade stu- 
dents, and 77 percent of sixth grade students are mas- 
tering the essential mathematics objectives of the cur- 
riculum Again, it is interesting to note that in the 
school that participated in the mastery learning ap- 
proach, an average of 89 percent of third grade stu- 
dents, 84.4 percent of fourth grade students, 85.9 per- 
cent of fifth grade students, and 68.7 percent of sixth 
grade students mastered the objectives. Their perfor- 
mance is consistently better than the district-wide av- 
erage. 

To both administrators and staff members, the need 
for additional indicators of school effectiveness has 
become apparent. While achievement test data are 
valuable, many other indicators of improvement can 
be examined. Efforts are being made to document im- 
proved attendance at all grade levels. Information re- 
garding suspensions, grading, retentions, and gradua- 
tion rates is being gathered through a district 
computerized data-base program called OSIRIS. 

Participation in staff development has been grow- 
ing. One hundred percent of all elementary staff 
members have had inservice training in **outcome- 
based education.** One-third of all staff members 
have taken ITIP (Instructional Theory Into Practice) 
training. Staff members throughout the district are 
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also learning about and incorporating concepts such 
as team teaching and Cooperative Learning in addi- 
tion to the correlates of Effective Schools. 

Finally, over the past three to four years surveys 
regarding the attitudes of staff, students, and parents 
have been developed and conducted as a result of in- 
dividual school improvement plans. These informal 
indicators can often provide the most valuable in- 
sights into how well schools have met the individual 
needs of staff, students, and parents. Such qualitative 
data are valued by the administration and staff of East 
Detroit. 



How Has the Effective School 
Process Influenced the 
Following Program Components? 

The Effective Schools process has had a significant 
influence on people, programs, and the instructional 
process in the East Detroit schools. Most importantly, 
the process has affected how both administrators and 
teachers discuss program and attempt to resolve prob- 
lems. A greater emphasis is placed on professionalism 
at all levels and the need to use research-based infor- 
mation in making decisions. 

To resolve questions related to the district's mis- 
sion and program components, East Detroit used the 
Outcome Driven Developmental Model (ODDM) 
Problem Solving Model developed by the Johnson 
City schools in New York. The ODDM Problem 
Solving Model requires that five important questions 
be asked when addressing concerns: 

1. What do we want? 

2. What do we know (research)? 

3. What do we believe? 

4. What do we do? 

5. What do we want to become? 

In answering these questions, the staff is able to re- 
view concerns and needs, and make quality decisions 
regarding curriculum, instruction, and the many diffi- 
cult problems related to the learning environment in 
general. 

The Curriculum 

In response to the question, **What do we want?" 
the initial Effective Schools/School Improvement Plan 
adopted by the East Detroit Board of Education in 
January of 1986 included an ambitious plan for a K- 
12 curriculum review in all of the major subject 
areas. The assistant superintendent along with two K- 
12 curriculum coordinators and three secondary level 
curriculum coordinators are leading efforts to improve 
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the curriculum. The general purpose of all curriculum 
committees is to involve the staff in the effort to pro- 
vide continuity and consistency in programming 
across and between grade levels. District-wide adop- 
tion of curriculum materials is promoted in all areas. 
Between 1984 and 1988 adoptions included textbooks 
for reading, English, mathematics, science, and social 
studies. Numerous adoptions of secondary level text- 
books for specialized courses were also completed. 

Throughout the process of curriculum development 
in all major content areas, committees work to de- 
velop curriculum guides. Bec^»»:se of the Effective 
Schools process and the ODDNf Problem Solving 
Model, the curriculum guides reflect much more than 
a scope and sequence of skills to be mastered. Teach- 
ers give more attention to the total instruction and as- 
sessment program in each content area, and guidelines 
include objectives, materials, instructional strategies, 
corrective and enrichment ideas, and suggestions for 
assessment. The complex process of curricular align- 
ment is seen in the many drafts and revisions of cur- 
riculum guides as committees work to define and re- 
fine the instructional program. 

Throughout the process of reviewing the K-12 cur- 
riculum., the instructional staff has identified areas in 
which new units and courses need to be developed. 
The curriculum review process has led to the identifi- 
cation of significant gaps in instruction, and to greater 
continuity in the K-12 program. At the junior high 
school level, staff members arc developing an explor- 
atory program that reflects the needs of adolescents 
and a program for at-risk students. At the secondary 
level, the tracking of students has been reexamined 
and is being systematically abandoned. 

Program Implementation 

In implementing instructional programs, the staff 
of the East Detroit schools has made a commitment to 
being 'Mntentional" about identifying instructional 
objectives and employing good instructional strate- 
gies. Such planning is focused on helping each 
learner to achieve the desired outcomes for the grade 
and course of instruction. Emphasis is placed on pro- 
viding high quality instruction to whole groups while 
providing corrective and enrichment support to those 
who need it. 

A concurrent step is providing inscrvice for staff 
on the instructional process. From 1984 through 1988 
numerous opportunities for inservice in the Madeline 
Hunter ITIP have been offered to the staff; approxi- 
mately one third of the staff has participated. As the 
staff has become trained in ITIP procedures, curricu- 
lum guides, unit guides, and lesson guides have begun 
to reflect the ITIP instructional process. 



The administration recognizes that * 'change is a 
process and not an event.** Thus, successful imple- 
mentation of new curriculum will occur over time. 
Teacher commitment to the curriculum development 
and implementation process is essential, thus teacher 
input is essential at every stage of the change process. 

Team planning is promoted in a variety of ways 
depending on staff and building needs. Experiments 
in whole group instruction are being promoted, as 
well as teaming for taching of specific units or con- 
tent areas. Grade leve* teaming or cross-grade group- 
ing may be used to create whole group instruction 
while meeting the needs of developmental differences 
in specific subject areas. 

Teachers are also encouraged to make classroom 
visitations to learn from each other. The staff pro- 
vides a wealth of knowledge to be modeled and 
shared. One of the most successful events has been a 
mini-conference in reading strategies in which teach- 
ers explained and modeled instructional strategies. 

Program Evaluation 

Existing instructional programs and programs to 
improve the learning environment need to be evalu- 
ated continuously through informal and formal mea- 
sures. In asking "What do we want?*' the staff of 
East Detroit also asks, **Is what we*re doing helping 
us to get what we want?" The question is applied to 
curriculum, as well as concerns about discipline, 
building climate, and instructional strategies. More 
formal evaluations are outlined in school improve- 
ment plans of individual buildings and include staff 
surveys, parent surveys, development of data bases 
using standardized and criterion-referenced testing, 
and disaggregated analyses of the performance of sub- 
groups of the school population such as gender and 
mother's education. 

While the administration and staff values such 
studies of student performance, the current emphasis 
of the Effective Schools process is on program im- 
provement. Until the program improvements are 
firmly in place, such data will provide baseline infor- 
mation for examining future successes. 

Staff Evaluation 

Communication, the hallmark of the Effective 
Schools process, includes staff evaluation of the ques- 
tion, "Hov are we doing?" Continuous dialogue is 
promoted, and more formal surveys of staff needs are 
conducted frequently. While individual buildings 
evaluate their own progress, district committees con- 
tinuously evaluate the needs of the district as a whole. 
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All staff development activities are evaluated and, 
when appropriate, results shared with staff. 

Community Attitudes 

East Detroit has enjoyed the reputation of having 
excellent schools with few of the problems that could 
plague a district bordering a major urban area. The 
innovative programming is recognized in the county, 
and businesses are renewing their interest in the 
schools. A number of school-business partnerships 
have been established. Civic groups have been asking 
for presentations on school improvement. The ele- 
mentary schools report good attendance at parent con- 
ferences and school activities. Parent support groups 
work to support the school programs and to pass 
needed tax millages. 

As a result of the Effeaive Schools program, par- 
ent groups are focusing their attention on the efforts 
to improve curriculum and the total school program. 
The board of education and parent groups have partic- 
ipated in workshops on topics such as the instruc- 
tional process and "reality therapy." 

The Effective Schools process has influenced many 
policies, procedures, and practices. Most changes that 
have occurred reflect the district-wide effort to pro- 
vide consistency in policies and procedures and to 
communicate more effectively to both students and 
parents. 

Student handbooks have been revised at all levels 
and reflect the district-wide school mission and all 
relevant policies, procedures, and practices. Efforts to 
explain policies to the students and community are of- 
fered at all levels through parent-teacher organization 
meetings, conferences, and school programs. 

How Does the Effective Schools 
Process Affect the Way Student 
Achievement Is Measured? 

The leadership is aware of the dilemma created by 
the ability to test and measure how well students are 
learning the curriculum, and the problem of measur- 
ing what is truly valued in the curriculum. Neverthe- 
less, assessment information provides data on whether 
children are learning in general and whether specific 
subgroups of children are learning as well as other 
subgroups in the course of finding out how well spe- 
cific subject matter is being mastered. 

School personnel have analyzed student learning 
by conducting disaggregated analyses. Subsets of the 
student population have been compared by parent ed- 
ucation groups and by gender. Where disparities ex- 
isted, school improvement plans have outlined efforts 



to assure that causes are not related to inadequacies in 
instructional practices or programs. 

Curriculum-based testing is the product of curricu- 
lum development in the major subject areas. As cur- 
riculum guides and unit guides are developed, testing 
will be further aligned with instruction. Assessment of 
prerequisite skills is being included in unit develop- 
ment in many areas. In addition, formative and 
summative tests are being developed. 

Several instructional programs include criterion- 
referenced tests. The elementary reading and mathe- 
matics programs include computer managed assess- 
ment programs that provide the teachers with 
convenient and efficient measures of student learning. 
Such programs are providing the administration and 
teaching staff with information for evaluating the cur- 
riculum, program, and needs of students. In addition, 
the state assessment tests provide criterion-referenced 
data on student performance in the areas of reading, 
mathematics, and science in grades four, seven, and 
ten. 

Standardized tests are used to compare the general 
progress of students in the East Detroit schools with a 
nationally normed population. The administration and 
staff realize that such data allow evaluation of how 
students are progressing. Standardized reading tests 
are given district-wide in grades six through ten. The 
IOWA Test of Basic Skills is used to assess a broader 
range of student learning. Baseline data from these 
tests an being gathered for longevity studies of the 
effects of the Effective Schools/School Improvement 
Program on learning in general. 

While the Effective Schools process has raised 
awareness of the need to examine how well children 
are learning and **How are we doing?" it has also led 
to questions of whether test« measure what is valued 
in the curriculum. The focus of many tests on isolated 
subskills or knowledge level information is being 
challenged across the curriculum. Leading educators 
are questioning the effects of testing on teachers' 
sense of professional competence and their ability to 
make or influence important decisions about educat- 
ing children. 

Curriculum committees are evaluating assessment- 
of-leaming instruments, and making recommendations 
for modifications in commercial programs. Methods 
of evaluating student performance may include sur- 
veys of student attitudes, surveys of teacher observa- 
tions, and surveys of parent perceptions. Behavior in- 
ventories in such areas as reading readiness may be 
used in conjunction with commercial assessments that 
accompany readiness programs. Other inventories 
may be used to assess higher-order thinking in con- 
tent areas. Portfolios representing student performance 
are being considered. Such data will be examined 
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along with norm-referenced and criterion-referenced 
test results. Disaggregated analyses will continue to 
be used to assess whether the schools are equitably 
serving all subsets of the student population. 

Conclusion 

In general, the Effective Schools process has 
brought focus and structure to the efforts of all in the 
district. It has revitalized the communication among 
the entire staff and has released creativity in develop- 
ing plans for continued school improvement at the 
building and district levels. The Effective Schools 
process has forced examination of the practices that 
are known and believed to be most effective. Staff 
have questioned and in some cases discarded those 
that were judged to be less effective. This has al- 
lowed East Detroit to agree that its schools may be 
good, but **things can be better.** 

Most importantly, the Effective Schools process 
has resulted in the district-wide mission statement that 
**all children can learn.'* In East Detroit, it is clear 
that the students are the beneficiaries of the Effective 
Schools process. Every effort is made not to select 
and son children and to ensure that programs are in- 
clusive rather than exclusive. All children are offered 
a **rich** curriculum, as opposed to reserving enrich- 
ment for a select few. The former **gifted** program 
has been restructured into an enrichment program 
available to all students through the regular classroom 
and through after-school opportunities. 

In most discussions, the most critical question re- 
garding policy and program asks, **Is this good for 
kids?** The district-wide statement of outcomes in- 
cludes the goal of promoting the self-esteem of each 
student as a learner and as a person. Instruction is 
success-oriented and recognition of achievement in 
academic and non-academic tasks is recognized and 
rewarded. Building mottos and mission statements are 
posted in hallways and in classrooms. Bulletin boards 
and display cases feature students with smiling faces 
and examples of student achievement. Student work is 
displayed in hallways and in classrooms. There is 
clearly a more intentional effort by staff to be posi- 
tive and to promote pride in self and the school expe- 
rience. 



Reflections 

The East Detroit Public Schools effort to improve 
schools is typical of the many districts involved in 
such programs. Change brings many frustrations, yet 



it also creates many challenges that can revitalize a 
district. 

This review of one districl*s efforts to improve its 
schools establishes that change is a process, not an 
event. One would like to prescribe the perfect school 
improvement plan, the perfect **event.** Yet that is 
likely to be impossible. While districts and schools 
must identify their unique needs and establish their 
own plans, some of the problems might be allayed by 
providing for the following. 

Awareness for Ail Staff Members 

It is essential that all staff members be included in 
the early awareness sessions that introduce the Effec- 
tive Schools Research and the concept of school im- 
provement. It is important to gain the interest and 
commitment of all staff members before conducting 
surveys, identifying building teams, and developing 
plans. When a district does not introduce all staff 
members to the process, there is greater risk of the 
school improvement process being viewed as a top- 
down administrative effort to have staff improve their 
performance. 

When awareness is provided to all staff members, 
an understanding of many of the issues surrounding 
school improvement in general can be developed, and 
the more likely result will be district-wide commit- 
ment to the process. 

Needs Assessment Surveys 

It is necessary to preview and adapt the respected 
school improvement needs assessment surveys so that 
they use language that is appropriate to the district. 
For example, titles of administrators or references to 
types of programs that may be appropriate for one 
district may cause great confusion and frustration to 
staff members in another. It is necessary to review the 
needs assessment surveys carefully and make appro- 
priate adjustments before distributing to staff mem- 
bers. 

Establish District Goals and Focus 

The school improvement goals of the district must 
be clearly listed and should provide the focus that is 
needed to help all schools and staff members move 
toward achieving the goals. The seven correlates of 
Effective Schools provide perhaps too broad a range 
of areas of concern. A district SIP plan can address 
long range (3-5 years) and short range (1 year) goals. 
This would help to provide focus for the district-wide 
efforts to inform staff about Effective Schools Rc- 
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search and ongoing school improvement programs 
within the district. 

Communication Networks 
Need to Be Established 

Both form.3l and informal communication networks 
on a district level and building level need to be estab- 
lished. Reading lengthy newsletters is unrealistic; but 
brief research summaries, announcements, or stories 
about school improvement can become partsqf a com- 
municf.tion network to disseminate information about 
SIP progress. 

Limit Committees— Focus Activities 

A district-wide school improvement program might 
consist of a district steering committee, building com- 
mittees, and teams of staff members engaged in spe- 
cial but temporary projects. The charge of the com- 



mittee needs to be clearly established and time lines 
developed. It is easy to establish new committees to 
address needs as they arise (discipline policy, grading 
and reporting, etc.), yet loo many committees or task 
forces can cause the program to appear to lack direc- 
tion and purpose. 

Develop Base-Line Data 

The existing data on student performance may pro- 
vide the base-line data that are needed to establish 
whether schools are improving. It is important that an 
organized and systematic method be established to co- 
ordinate the gathering and analysis of data. Appropri- 
ate graphs and charts need to be developed and put 
on computer so they can be easily adapted each year. 
Each district needs to identify what information needs 
to be collected and develop a method for easy input 
and retriewil of information in the form that is most 
understandable (graphs, charts). 
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Mishawaka School District 

Became involved in Effective Schools process in 1985 
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Abstract 



The School City of Mishawaka's case study 
delineates specific steps taken, the sequence 
of these steps, and the general reactions of 
constituent groups. The SWEAT (System -wide Ef- 
fective Action Team) is the primaiy district coor- 
dinating vehicle for the school improvement 
program. From their deliberations an orderly 
planning process fans out to building-level 
teams (BLTs). Building plans are **reviewed, re- 
vised, and approved" in the schools before 
they are submitted to the board of education 
for final approval. The plans, three-year projec- 
tions, are updated every year. 

Because the Effective Schools process for 
school improvement has been in effect only 
one year (1987-88), achievement scores have 
not measurably Increased. The district switched 
from the Iowa Test of Basic Skills to the Califor- 
nia Achievement Test in the spring of 1988) and 
so new base-line data have been gathered. 
Disaggregotbn of student scores along socio- 
economic status categories has been per- 
formed since the beginning of the program. Be- 
cause tests are given only at the third, sixth, 
eighth, and tenth grade levels, and there are 
no district-wide criterion-referenced tests, 
Mishawaka's student monitoring system is not 



yet devetoped enough to be useful for school 
improvement based on Effective Schools Re- 
search. 

However this is one of the best cases in this 
monograph to demonstrate the complexity of 
**starting-up" procedures. Quotatbns from a 
personnel questionnaire bring alive the personal 
and professional concerns of staff, central of- 
fice administrators, and principals. 

An extensive Appendix to this case study is 
an example of a truly comprehensive ap- 
proach to school improvement based on Effec- 
tive Schools Research. Mishawaka was fortu- 
nate to begin their process when more was 
known about the importance of strong support- 
ive district relationships with schools. Some of 
the forerunners, like Jackson, Mississippi; Norfolk, 
Virginia; Spencerport, New York; and others 
cited in this monograph had already designed 
reporting systems, and other feed-back and co- 
ordinating structures to carry the school im- 
provement process forward. Mishawaka is a 
good example of what works when leadership, 
commitment, and quality staff development 
programs are added to the fundamental Effec- 
tive Schools Research model. 



E^:_ 114 ' 



The City of Mishawaka 

Mishawaka, a city of approximately 40,000 people, 
is located just east of South Bend in the northern part 
of St. Joseph County, Indiana. Mishawaka *s economy 
is based on services and industry. Major employers 
include Uniroyal, Inc., Nyloncraft, Liberty Mutual In- 
surance Company, Miles Laboratories, Inc., School 
City of Mishawaka, and Civil City of Mishawaka. 
Currently the community is ''shifting** from a highly 
industrial base to a service-based economy. 

School City of Mishawaka (SCM) covers 8.5 
square miles and serves 85 percent of its resident 
children. The remaining children attend school in 
neighboring districts and parochial schools. The 
Mishawaka Municipal Common Council appoints a 
five-member board of school trustees to govern the 
school district. Operating funds come from state sup- 
port (approximately 50 percent), local taxes (approxi- 
mately 45 percent) and other sources (approximately 
5 percent). The local school tax level is $5.81 per 
$100.00 of assessed valuation. The annual, expendi- 
ture per student in 1987-88 was $2,420. 

Over 5,300 students attend the eight elemenrary 
schools (grades K-6), two junior highs (grades 7-8), 
and one senior high school (9-12) within the 
Mishawaka School Corporation. The system is stafl^d 
by 34 administrators, 318 teachers, and 142 supptort 
staff. Pupil-teacher ratios average 20-1 and are unsur- 
passed by most public schools in the area. Great pride 
is taken in maintaining facilities in such a way as to 
provide a safe and orderly school climate conducive 
to teaching and learning. The Mishawaka Administra- 
tive Center houses the business and instructional ad- 
ministrative offices, the Hannah Lindahl Children*s 
Museum, and the ** Survive Alive House** (fire safety 
program). 

The corporation *s commitment to the ** neighbor- 
hood school concept** encourages personal contact 
between parents and school personnel. This close re- 
lationship permits ongoing communication and close 
supervision of each child*s school-related activities 
through the Mishawaka system. Elementary students 
reside within walking distance of the school they at- 
tend. Transportation is provided only for special edu- 
cation students who need programs outside their nor- 
mal attendance areas. 

The following statistics describe the student popu- 
lation: 

Percent 

Socioeconomic status 
Single parent homes 23.7 
Mothers with less than 

high school degree 21.0 

ill 
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Mothers with college 

education 50.78 

Free lunch program 16.50 

Reduced lunch program 5.44 

Ethnic background 

White 97.03 

Black .97 

Hispanic .875 

Asian .746 

Other backgrounds .136 

Language spaken in home 

Only English 98.95 

Second languages .796 

Non-English .220 



Motivation for Launching the 
Effective Schools Process 

In June of 1985, at the invitation of the superinten- 
dent of a neighboring school district, the entire ad- 
ministrative staff and teacher association leaders of 
the Mishawaka schools, along with like members of 
the neighboring district, participated in an intensive 
two-day workshop on Effective Schools Research. As 
a result of this persuasive, logical approach, the 
Mishawaka district decided to study and review the 
entire instructional program during the 1985-86 
school year. 

Although the over-all consensus was that the 
school district had an admirable "track record'* of 
educating the youth of Mishawaka, participants in the 
workshop concluded that the implementation of the 
Effective Schools process should be encouraged. 

• Certain practices have been proven to be more ef- 
fective than others in the teaching and learning 
process. School leaders wanted to be certain that 
these proven practices were being followed in 
every classroom. 

• The socio-economic status of Mishawaka students 
is changing. The challenges of negative societal 
factors needed to be addressed with new, proven 
practices and procedures. 

• The dynamic nature of education itself mandates 
the need for constant efforts to improve. 

• Self-renewal efforts in purposeful cycles must be 
implemented for schools to continue to be success- 
ful and effective. 

• Citizens and legislators are demanding public 
school improvement and accountability. 

A History of Launching SCM*s Programs 

School City*s commitment to a process of school 
improvement based on Effective Schools Research 
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began in June of 198S, when administrators from the 
school corporation attended two Effective Schools 
workshops. On August 26, 1985, the entire staff at- 
tended a meeting at which Superintendent Richard 
Brainerd presented the Effective Schools model for 
improving the quality of education for all students in 
the Mishawaka School System. 

From November 1985 until April 1986, teams of 
administrators and teachers presented the correlates of 
Effective Schools to every instructional staff member 
in the school corporation. During this time, adminis- 
trators and selected teachers attended institutes pre- 
sented by researchers and practitioners of Effective 
Schools Research. On May 5 and 6, 1986, Lawrence 
Lezotte met with administrators and selected teachers 
from each school in the system to provide suggestions 
and to outline actions to start the Effective Schools 
process. 

June 10, 1986, the board of school trustees di- 
rected the administration to prepare a district plan for 
proceeding with the Effective Schools process. During 
June and July 1986, administrators and teachers de- 
veloped a three-year plan. In August the board gave 
its approval. During this time, staff members attended 
a variety of workshops which related to skills needed 
to implement the plan. (See Appendix to this Case 
Study.) 

The Key Leaders . . . "SWEAT" 

Dr. Lezotte met with the entire staff on October 
29, 1986 to share his expertise on the Effective 
Schools process to all 494 employees. That afternoon 
all employees completed a survey that was designed 
to help identify both strengths and areas needing 
strengthening in Mishawaka schools. 

In December 1986, the System-wide Effective Ac- 
tion Team (SWEAT) was formed. Led by Assistant 
Superintendent Steve Mills, this team oi representa- 
tives (principals and teachers) from each of the ten 
schools were given specific tasks to take back to their 
buildings. 

The assistant superintendent for personnel; the as- 
sistant superintendent for curriculum evaluation and 
secondary education; the directors of gifted and tal- 
ented programs, computer education, the joint ser- 
vices of health, physical education, and safety; and 
the school psychologist made up the representatives 
from the district office. The Mishawaka Educational 
Association president, Bruce Shannon, was also a 
member of the SWEAT team. 

March 27, 1987 marked the culmination of one 
and one-half years of research, study, and preparatory 
work. On that day, the entire school corporation staff 
met in their individual buildings for "Staff Develop- 
ed 
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ment Day." During these meetings, each school dis- 
cussed the preliminary draft for school improvement, 
and the response was overwhelmingly enthusiastic. 

At each building, a building-level team (BLT) was 
formed, composed of the building's SWEAT repre- 
sentative, a central office administrator, the school 
principal, and both certified and support staff mem- 
bers. Each school-level team wrote, then reviewed, re- 
vised, and approved a final written school improve- 
ment plan for its individual school. These plans were 
submitted to the school board on June 9 and 11, 
1987, and were approved at the June 23, 1987 meet- 
ing of the board. 

In September 1987, all schools selected community 
representatives to serve on their building-level teams. 
These representatives included school parents, busi- 
ness leaders, and senior citizens. 

SWEAT-ers met one day a month during the 
school year; teacher reps were given release-time for 
that day. The building-level teams met at least once a 
month, generally prior to the SWEAT meeting. While 
most of the original SWEAT will be back for the 
1988-89 school year, several chose to name replace- 
ments chosen from those teachers attending the last 
two meetings of the SWEAT. The high school re- 
quested additional teacher representatives, so that they 
now have three teachers on the 1988-89 team. 

Individual School Teams 

Each school has a building-level team composed of 
the school principal, the SWEAT representative from 
the building, a central office administrator, various 
teaching support staff members and representatives 
from the community. Every building has a three-year 
pian, which is updated yearly. 

Funding the Process 

Funding required to meet the goals established by 
all schools for the 1987-^ school year required a 
$43,000 appropriation by the school board. A budget 
of approximately $40,000 to fund the projects for the 
1988-89 school year is expected to be approved by 
the school board. 

Sources of Program Support 

The board allocated monies from the general fund 
and uses stale funds to support school improvements. 
Indiana's '*A+ Program" has many provisions which 
support some of the Effective Schools projects. A 
$12,000 Teacher Quality Grant from the state will 
provide 22 teachers with Essential Elements of In- 
struction training this summer. A Phi Delta Kappa 
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Teacher Training Grant provided for two teachers to 
undergo similar training. 

Symbolically, the board and superintendent have 
made the Effective Schools process an obvious 
** Number One'' priority. The board has called special 
meetings to hear from all building-level teams. The 
board has approved system-wide guidelines for poli- 
cies submitted by the SWEAT. At these meetings, the 
board expressed delight in the progress being made. 
For the first time ever, the district held a * 'Teacher 
Recognition** Banquet on May 23, 1988. Every board 
member and all SCM administrators were present to 
congratulate and recognize the system's teachers. 
Prior to the banquet, the board proclaimed a 
"Teacher Recognition Day.** Superintendent Brainerd 
went to every school on that day and personally pre- 
sented every teacher with an enameled apple pin with 
**I made the difference** engraved on it. 

Numerous staff development inservices were held 
at each building and system-wide during the year. 
The chances for personal-professional development 
were supported at every level. A teacher mentor pro- 
gram was officially launched at the end of the school 
year, with 26 volunteers responding. 

Measured Student Outcomes 

At this juncture. School City of Mishawaka can 
provide no hard evidence that schools are improving. 
During the 1986-87 school year, all schools in the 
district used a disaggregated analysis of student 
scores in reading and mathematics on the Iowa Test 
of Basic Skills to establish baseline data for use with 
the building-level needs assessments. Students were 
categorized for this purpose based on the educational 
level of the mother. Three test score categories (stu- 
dents whose mothers had not graduated from high 
school, students whose mothers had a high school di- 
ploma, and students whose mothers had a college de- 
gree) were established for this purpose. Student scores 
were plotted graphically so that the three categories 
of students could be compared for equity and achieve- 
ment at the 40th and 80th percentiles of achievement. 
A great shortcoming of this process, beyond the fact 
that the district was not using criterion-referenced 
testing, was that the district had tested children only 
at the third, sixth, eighth, and tenth grade levels, thus 
making it impossible to follow the progress of spe- 
cific students continuously from one grade to the 
next. 

During the spring of 1987-88, School City of 
Mishawaka changed from the Iowa Test of Basic 
Skills to the California Achievement Test, and is now 
testing at all grade levels annually. Currently the sys> 
tem is in the process of performing a disaggregated 



analysis of these test results to once again establish a 
baseline for measuring improvement. This process 
will be conducted yearly and will form a basis for 
measuring growth in student achievement. 

Documented Changes Related 
to the Correlates 

Since the implementation of School City's Effec- 
tive Schools program is only one year old, docu- 
irented facts and figures are not available at this time. 
Responses to a survey given to teacher, central office 
administrator, and principal representatives on the 
System-Wide Effective Action Team are condensed 
here. 

Teachers: Improved communication within and among 
school buildings has contributed positively to almost every 
Effective Schools correlate. A system -wide grading scale, re- 
tention policy, and homework policy have made a statement 
to the school community and the community at large as to 
what we want to accomplish with the students in our 
schools. 

Administrators: People are not beginning to equale or relate 
test scores to instruction and ultimately to teacher behaviors. 

Principals: The strength and presence of the correlates of 
Effective Schools are documented in a system -wide 
assessment, training for principals in instructional areas, 
school and system mission statements, the existence of 
collected demographic data in all our schools, an awareness 
of SES groups and related student achievement, and the 
functioning task committees and building-level teams at e.ich 
school. 

Other Organizational or Personnel-Related 
Improvement Data 

Teachers: Broad-based decision-making has resulted in de- 
cisions that reflect staff feelings and ideas. The availability 
of programs to improve instruction have improved skills and 
teacher self-concept. Enthusiasm is visible in school 
buildings. Teachers are talking about improved schools re- 
sulting from changes initiated by needs identified by staff 
members. 

Administrators: Needs have been assessed. Plans are in 
place for improvement. People arc actively thinking about 
how to get better. 

Principals: Increased communication among staff; increased 
awarcncss of effective instruction; increased awareness of 
the value of current research ... the Effective Schools pro- 
cess provides the structure for change Inscrvice sessions de- 
voted to building-level concerns . . . gym schedules built 
around instructional needs! A shift from climate to personal 
improvement and development. 

Battell School principal Dan Wilson uses words 
like ''excellent*' and **very important'* when he de- 
scribes what has been doing on at Battell School 
since last January. **When BEAT, the Battell Effec- 
tive Action Team, first met to discuss the steps our 
total school staff should take to prepare for a three- 
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year plan for school improvement, there was some 
skepticism as to whether such a monumental task 
could be accomplished," stated Wilson. **But," he 
continued, **as the process evolved, ii was met with a 
lot of excitement and enthusiasm when results from 
the individual study groups started to form,*' The 
total staff at Battell School spent months gathering 
data, studying the results of a school sirvey, and 
learning what Effective Schools Research had to 
offer. 

Professional and General Staff 
Deveilopment Programs 

Staff development programs are seen in a more 
positive light since the implementation of the Effec- 
tive Schools program. Since many of the programs 
are building-based, the contents of the programs meet 
the needs and interests of the staff and students much 
better than previous efforts. Current development pro- 
grams are geared more to the improvement of instruc- 
tion than in the past. 

The 1987-38 Young Junior High School Staff In- 
service Calendar was as follows: 



August 24, 
1987 

October 13, 
1987 

November 10, 
1987 

December 9, 
1987 

December 14, 
1987 

January 6-7, 
1988 

January 15, 
1988 



February 2, 3, 4, 
and March 29, 
30, 31, 1988 

February 5, 
1988 

March 14, 
1988 



Effective Schools Agenda 
and Computer Training 

Inservice on Middle School 
Concepts 

Inservice on Test 
Construction 

Follow-up on Test 
Construction 

Inservice on Creativity and 
Motivational Thinking 

Great Book Northern 
Indiana Regional Workshop 

Inservice on Interdisciplinary 
Teams and Middle School 
Conference Sharing 



Staff Writing Workshops 

MGAP and CSPAN News 
Access Presentations 

Dr. Joel Milgram, Inservice 
on Understanding Trans- 
escenls 



Currently, a system-wide staff development pro- 
gram based on Effective Schools Research is being 
compiled. Specific components include: 



Teachers: Staff development programs have improved; they 
are more useful in regard to more effective instruction. 
Attendance at other programs is also encouraged. Staff 
morale has improved. Changes have resulted or will result 
from needs as they are identified by staff. 

Administrators: Staff development is much more focused 
now; the Effective Schools process provides a basis for 
making staff development plans — not just whatever comes 
along. 

Principals: Staff development now centers on 
building-identified needs and has a specific purpose. The 
focus on improving the schools has provided structure for 
identifying needs; this same structure will provide direction 
for years to come. Efforts are more focused now. The clearer 
focus created by this process has allowed the staff to also 
maintain that clear mission. 

Curriculum 

Teachers: Specific statements and objectives make 
curriculum easier to implement and tell exactly what is 
expected. Changes are taking place in response to needs 
identified by teachers. 

Administrators: People understand the need and concept of 
a unified curriculum that teaches what we test and vice 
versa. 

Principals: The curriculum model is in place. One principal, 
who is co-chairing School City's reading adoption 
committee says that this year's committee is unlike any 
previous adoption committees. First, they began their search 
for a text by developing a statement of direction. The 
committee is functioning much like the building-level teams. 
They have also used outside consultants to give two-day 
inservice workshops on selecting a reading textbook. 

Program Implementation 

Teachers: Timelines and guidelines tie all schools together. 
Teachers are able to attend programs and inservice sessions 
designed to improve instruction. Involving staff members in 
planning for decision-making has decentralized the 
implementation of programs that needed change. Leadership 
is spread throughout the system's schools. 

Principals: The presence of the "Essential Elements of 
Instruction" inservice programs for administrators, 
principals, and staff. 

Program Evaluation 

Teachers: System- Wide Effective Action Teams bring 
viewpoints from the schools to the administration. This 
increases the amount of staff input; it is more representative 
of total staff views. 

Principals: Program evaluation is now a part of the 
curriculum model. It provides a systematic way to use test 
data that will be used to measure any progress. 

Staff Evaluation 

Principals: Stresses helpful suggestions to make each 
instructor more valuable to students. Avoids criticisms that 
destroy teacher sclf-oonccpt. Has provided for increased 
awareness of the need for change in our present system. 
TESA and Essential Elements of Instruction inservice 
sessions, together with other workshops designed for 
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principals in the area of staff evaluation, have made them 
feel much more comfortable with the process. 

Historically, personnel evaluation has been used in our 
system as a means of determining whether or not an 
employee remained an employee of our school system. As a 
result of the Effective Schools program, evaluation has 
become much more of a fonnative process between the 
employee and the administrator. All administrators within 
the school system have received and are continuing to 
receive training in the areas of the essential elements of 
instruction and the formative evaluation process. All staff 
members are to be observed annually and pre and post 
conferences will be held between the staff member and the 
administrator to mutually determine areas of growth. This 
process, along with the results of the building-level needs 
assessments and subsequent staff development plans for each 
building, are being utilized to strengthen the instructional 
skills of both administrators and teaching staff. 

Community Attitudes 

Teachers: Publicity and public relations efforts have 
increased awareness of what makes schools effective. 
Building teams have included community representatives to 
foster this involvement and to communicate results. 

Administrators: The community is much more aware of the 
instruction -related activities in the schools since the 
introduction of the Effective Schools program. 

Principak: Introduction of a weekly parent visitation 
program; improving of community attitudes since we arc 
publicizing more instruction -related items. Parent interest 
and involvement in the schools has increased dramatically. 

Service and Funding Agencies 

Teachers: Many sources are available that were unknown to 
us before. Suggestions on funding arc now networked 
among schools through the System-Wide Effective Action 
Team; many good ideas are generated. 

Recognition of the Instructional Process 

Teachers: Staff members are asking for information instead 
of being told that they need to increase skills and 
knowledge. "Their" school corporation has become **our*' 
school corporation. 

Principals: Emphasis put on instruction has never been 
greater, and has a very positive effect. Introduction of 
Essential Elements of Instruction inservice training and the 
annual teacher recognition program reinforces this. 

Disaggregated Data 

Student test data from the system's norm-refer- 
enced testing is currently being disaggregated and 
used to check for equity and excellence in achieve- 
ment. This is being done on a grade-by-grade bas;:; in 
the areas of reading and mathematics. The 40th and 
80th percentiles have been established as cut-off 
points for this purpose. Student test scores in these 
areas will be disaggregated, analyzed, and graphed on 
an annual basis to measure equity and growth. 



Development of Currlculum-Based 
Teatlng/Crlterion-Reference Tests 

A total revision of the student curriculum is under- 
way within the school system so that the total curricu- 
lum will be stated in outcome-based terms. This 
alignment has been accomplished in the areas of sci- 
ence and mathematics at the elementary level. The 
reading curriculum will soon be completed. At the 
secondary level, this has been accomplished in all 
areas. The goal is to establish criterion-referenced 
testing at all grade levels in all curricular areas. 

Development of Policies and Procedures 
at District and School Level 

A system-wide homework and promotion-retention 
policy have been written by SWEAT and approved by 
the board of education. Individual schools will then 
set their own policies using the system-wide policies 
as a guide. 

Teachers believe that this system-wide approach 
has established a vehicle for developing school-based 
procedures. Building-level teams and faculties de- 
velop written building procedures regarding routine 
matters, supplies, discipline, referrals, and scheduling. 
Regular team meetings help facilitate this process. 

Instructional and classroom practices are changing 
because teachers recognize the opportunity for mak- 
ing suggestions and seeing them discussed. Practices 
**that work" can become systematized and coordi- 
nated rather than * 'shotgun" and this change pleases 
administrators. 

It was important to take the first two years for dis- 
trict and school staff orientation, awareness, and plan- 
ning (1985-86, 1986-87), During the planning year, 
too many deadlines were set, however, and frequent 
meetings led many school staffs to feel **harried" by 
June (1987), One teacher remarked, 

I would not be in such a hurry to try to do everything in 
year one! I think the anxiousness showed. It would be good 
to begin the first-year needs assessment and evaluation of 
findings earlier in the school year in order to spread the 
tasks over a longer time frame. 

Principals agreed that decentralization made the 
central office more aware of the many budget deci- 
sions that can best be made at the building level. 
However, district restrictions in the first-year plan did 
not allow the building to complete plans for the many 
(too many) areas identified for attention. They agreed 
with their teachers it was better to concentrate on one 
or two important areas than try to do everything at 
once. 
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Administrators regretted not getting involved in the 
process early on. One district staff member remarked, 
**It is the most exciting and rewarding educational 
experience of my 24 years in education.** Administra- 
tors also felt a different needs assessment survey and 
procedure should be used. They would have made 
curriculum alignment an important priority from the 
beginning. 

Summary 

During the 1988^9 school year, School City of 
Mishawaka will be entering into its second full year 
of operation utilizing system-wide and building-level 
school improvement plans based on Effective Schools 
Research, as its vision and guide in a quest for excel- 
lence. Those affiliated with the corporation sincerely 
desire to provide Mishawaka students with a quality 



and equitable education which will offer them more 
choices and opportunities when they graduate from 
Mishawaka High School. 

Many things vital to the continuing educational 
growth of our school system have been accomplished 
during the past three years. These accomplishments 
have been outlined in previous sections. Many areas 
remain to be addressed before our schools can truly 
qualify as ^'effective** schools, including valid mea- 
surement of our progress. Most importantly, however, 
we have taken the first step, in committing ourselves 
to excellence. We have even taken the second step by 
putting that commitment into an organized plan for 
achieving excellence. In the third step, we actually 
began implementation of that plan. We are a vital, 
healthy, enthusiastic corporation; Mishawaka is an ex- 
citing place to be . . . with **miles to go, before we 
sleep.** 
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APPENDIX TO MISHAWAKA CASE STUDY 
EFFECTIVE SCHOOLS: Th« Mishawaka Pkin, August, 1986 



School City of Mishawaka Board of School Trustees 

Emery S. Petko, President 
Dale E. Emmons, Vice President 
Marilyn J. Gchroyer, Secretary 
Virginia H. Currey, Member 
Thomas L Klaer, Meml)er 

Richard L. Brainerd, Superintendent 



School Improvement Planning Committee 



Mary Ann Bogucki 
Chris Currey 
Terry Grass 
R. Steven Mills 
Dr. M. Kay Novotny 
Norma Pangrac 



Jerry Seese 
Robert D. Smith 
Doris Speicher 
Steve VanBruaene 
Pamela von Rahl 



introduction 

^ JU^ plan for-'scli^^^ in the School, City of MJ&hawakii, based on Effective Schools Research, 

.:-=Ma-pftnclp^ Eaa^h received" e)deni^^ natiohally recognized re- 

/.^J^arp^ anci adopted; by the -Mishawaka 

i^^^^^^^^^P^ '^^^^^M impJernefttati6h;in;idi;^^ " ■ ■ " ■■ 

llS'l^iiijilll!^^ fi^ ^ "^fl^e of' Effective Schools practiced ^^'thMes. If imple- 

|!i|m|ii||^;|t^ MlshawcOca sbhools; The steenng 

||^W||ei|;.t^|^^ buildln9;jflivel^^ support from the distrtct level is 

==-rtiiiSif'ifrS'^^ programs. Tbeii%3^j^ district has 

jj^ejp^ successfully ::fmplenierrt= this projectD V 

• ■ 

^ the butldir^ les^l as to broad guideftnes, expectations, and ac- 
1987^ and 198&^. ft is tntended W be- purposeful, 
;:.:>f*asd|rii^»^ Materials for communicating with support staff, students, patrorts. and the ccmr . 

■ IlififSpilM on irisiiliii^ are preserrted In tHia tblioiinHng areas in order 

to wppofttj|^^^ 

.■■g; ;■ • 

■ v'il^l^^ "Effective School 

TTli^*^^^ plan la Intendcld to be broad general; lit is e)q>ected:.that revfefon and updating w*« occur 

each., year. • . \.. 
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198&-d6 Background on Effective 
Schools Research ond School 
Improvement in Mishdwaico 

In June of 1985, at the invitation of the superir«endeht of a neighboring school district, 
the entire administrative staff of the Mishawaka schools, siong with like rriemljers of 
the neighboring district, participated in an inliHtslve tWo-day wc^^^ on Effective 
Schools. Also, teacher association leaders froni each school system were i^articipartts. 
The content of the ivvrkshop was based r>n resesu-dh of x\\e late Ron Edmionds, a 
pioneer in effective schools research, as tc ino characteristics of effective schools and 
the school imprcv'ement piocess. It was decided that this persuasive, logical approach 
was worthy of study and review by the entire instrudiona! staff during the 1985-^6 
school year. 

Subsequently, teams of teachers and administraitors prepared and presented five two- 
hour sessfons on the subject to the professional staff over the course of the year. One 
of Edmond's five '^correlates," or characteristics, was reviewed, described, and ana- 
lyzed during each session. The process of school improvement based on effective 
schools' research and practices was stressed to develop awareness, understatfiding. 
and interest of the staff. At the same time, extensive resesu-ch on the concepts, l)eliefs, 
and values of effective schools was accomplished by the members of each presenta- 
tion team. Each staff member received descriptive materials throughout the year for 
staff re\^ew, including the Effective School Report, a publication of the Kelwynn Group. 

The System-wide Instructional Improvement Council met five times throughout the year 
to discuss the correlates and the improvement process* In order to further familiarize 
key leaders with the effective schools improvement model, ten administrators and two 
teachers also attended institutes presented by researchers and practitioners describing 
successful implementation practices and significant data. 

All these efforts were intended to initiate, train, and commit Mishawaka instructional 
staff to school improvement based on Effective Schools Research. Substantial num- 
bers of teachers and administrators have expressed strong interest and desire to pro- 
ceed with implementation processes. 

With this as an objective, Dr* Lawrence Lezotte, a niitionally recognized leader in the 
Effective Schools movement and associate of Ron Edmonds, met with all administra- 
tors and selected teachers from each building on May 5 and 6, 1986. Dr. Lezotte pro- 
vided valuable insights and suggestior^s, and outlined possible actions to start the pro- 
cess, for implementation of a school improvement project in all the Mishawaka 
schools. 

Finally, on June 10, 1986, the board of school trustees determined that an effective 
schools project would have merit for the school corporation, and directed the adminis* 
tration to prepare a district plan for proceeding with such practices and concepts in all 
schools. This is that district plan. 
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DISTRICT PLAN FOR MISHAWAKA SCHOOLS 
Why School Improvomont is Necessary 

The schools !n Mishawaka have a long stoidlhg' of strong educational 
programs. Intense community pride 1$ reiadlly appai^iwit W and newcomers in the city. This 
pride stems, in part, from the stfitnlit^ and success; of s^ programs. Conditions and character- 
istics now exist that are usually associated with quad^ Oitizens in the area, and particu- 
larly in the Mishawaka community, have been supportive of good schooling and have expected 
delivery of positive programs tn their public schoola The Mishawaka schools experience active 
parental involvemeht, experience tow turribyer bt ceir^ classified personnel, have strong 
building-level administrators, practice collaborative' and coliegial decisibn-making, and are finan- 
cially sound, but not wealthy. Most tmportiEulitly/ most students generally express interest in learn- 
ing, and demonstrate reasonable behavior and attitudes/ In fact, those with contact In other dis- 
tricts as well as Mishawaka schools—parents and p^Uplls who have transferred into the district, 
substitute teachers, and those in higher education— testify to the quality, atmosphere, and offer- 
ings in Mishawaka schools. The synergistic effect of these positive factors has developed a sense 
of confidence on the part of the community in operation of the schools. The questions logically 
might be asked: Why is there interest or need to embark on an effective schools/school improve- 
ment project? With such a heritage and seeming Indicators of success, if things aren1 broken, 
why fix them? Do we have to be sick to get better? 

There are several answers to such queries: 

1. A growing body of research and current literattire strongly indicates a general consensi^s is 
emerging about the elements of effective schooling. Certain practices are more effective than 
others in the teaching and learning process, and should be sought in classrooms, in schools, 
and in school districts. Hundreds of schools across the nation have successfully Instituted 
such practices. Although the Mishawaka schools incorporate many of these practices now, 
others may be lacking. 

2. Although most Mishawaka youngsters have positive attitudes and behaviors and achieve well 
over national standards, increasing numbers do not The impact of negative societal factors, 
daigs and alcohol, lack of interest bx\6 motivation, poor basic skills, poor achievement, asser- 
tions that school is boring— all are factors that challehge schools to do something different or 
something better. Attempts to overcome these factors have met with limited success. If we 
continue to do the same things, it's reasonable to assume that weMI get the same results. 
Thus, we may need to abandon some practices and procedures, as well as change <«hers. 

3. Organizations are dynamic, not static, and thus, the assumptfon is made that schools either 
decline or improve in their attempts to adapt to societal and organizational changes— there Is 
no constant state. Our schools should improve, 

4. Successful organizations plan and implement continuing self-renewal in purposeful cycles in 
order to remain successful and effeaive. Schools should, too. 

5. Public schools in the nation have been criticized in recent years by various commissions and 
reports. There is a public and legislative demand for public school improvement and account- 
ability. 

School personnel and the board of school trustees recognize the legitimacy of these concerns, 
wish to continue the tradition of the district in pursuing excellence, and desire to respond in a 
forthright and ^responsible manner. Thus, the decision has been made to adopt a school improve- 
ment plan based on Effective Schools Research. 
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What Is Known About School Improvement 

Research on educational change has clarified and specified some of the ingredierts heo^ 
school improvement, "Change is a process, not an event " iiccording to Michael Futo^^^^^^^ 
gist, The interactive phases of the process are. described as ad<H)tk)ri, implemehtatiop, 
uation or institutionalization. For the purpose of bringing together the rese^^^^ 
school improvement literature, the following propositions are offered: 

Proposition 1 

Public schools, Individual classrooms, and school systems can and do improve, and ttie factors 
facilitating school improvement are neither so exc^ic, unusual, or expensive that they are b^ond 
the grasp of extraordinary leaders In ordinary situations. 

Proposition 2 

People matter most in school improvement programs: 

A, Teachers can and will implement new practices and programs, given active ieadership fro^ 
building and central office administrators, a chance for planning the implementation process, 
appropriate training, opportunities for interaction, breathing space to try and fail, and continu- 
ous assistance and support. 

B, Building-level administrators make a difference In school Improvement programs by estabfeh- 
ing a climate of expectations that teachers will successfully improve practice and by proykJihgi 
on-site coordination, communication, assikance, and support. 

C, District-level administrators affect school improvement programs by exhibiting active backing 
in the form of communicated expectations, for success, psychological support, needed re- 
sources* and local facilitation assistance. 

D, Externa! asststers are most effective at the school level by providing concrete and practical 
assistance on implementation issues, such as planning, scheduling, problem-solving, and fol- 
low-through. 

Propositions 

An innovation is more likely to be adopted and Implemented If It is perceived as having relative 
advantage, compatibility, simp^city, and legitimacy. Implementation is more effectivie when the in- 
novation focuses on a sp^wific need and demonstrates clarity in purpose and techniques. 



Proposition 4 

Specific resources are necessary to support effective school improvement programs. 

A, Staff sievelopment programs that are task-specific and provide ongoing, continuous assis- 
tance and oupport; and 

B. Monetary resources that are adequate to provide the people, materials, and time needed in 
the program. 
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Several schooi researchers have ideritifidd tlWse (ih the effective from 

the less effective schools. The number of charact^^^ study, because of 

the Research design or the Way in which iifihe^"^^(^ 
from ainy feiat confHcte in the research ifihdirijas:^^^ 
•resMrc^' oin characteristics: ■ ' 

1. School effectiveness encompassed thi^ ^t well as class- 

ro<>m management and teaching. ^0 ^^^^^ ; ^ ; 
Z The characteristics tan be defincld and^^i^^ that 

all must be in place, at least id some jd^^^^ 
a The ihteractidn of the characteristi^^^^^ results 

in an impair that is greater than if th6 charact^n^cs^^^^ 

The School City of Mishawaka will use the fiV^ fcharakJter^^^ (effective schools as 

identified by Ron Edmonds. These were used fbr S^^ staff 
during the 1985-86 schooi year and are familiar to the stafif» the f6ll<^ing characteristics, or cor- 
relates, will be used to guide decisions, plannirig^ahd inipiementatiori^ school Improvement 

project:- ■ -I/-: :. ^^V^ ''.: 

1. Positive School Climate 

There is a safe, orderly, and i>Urpas6fui etivironment which is conducive to teaching and 
learning/ The atmosphere reflects a fd<;us bh student ac^^^ the accomplishment 

of the schoors mission. Staff and studeritii sli^ the students* ability to learn. 

Staff and students consistently accfept respohsibili^ f established standards of behav- 
fors and respect the%hoof as a place^^^ 

2. Clear and Focused School Mission 

The major focus of the^ ischooi is cleariy identic instiructionai. A standard district cunricu- 
lum is established and instructional goals are clearly defined. There Is a shared staff under- 
standing of, commitment to, and resporiiibiltty foi- clearly articulated goals, objectives, priori- 
ties, and assessment procedures. 

3. Strong Instructional Leadership 

The principal acb as the instructiortkl leader who effectively communicates the mission of the 
school to staff, jparents,- and^tudents^ The pwi^^ the characteris- 

tics of instruction^ effectiveness in the managerhent of the instrtictionaJ program of the 
school Staff members are Iriyolyed in deaislonrmaking^^^OT^ share a leadership role in the 
improvement bf tnstructbhal ef^^ 

4. Teacher Behavtors V\^ich Convey 

The staff shares; the belief that all studenitsic^ l^ convey to students the 

expectation that airsSudehts ft (east 16 a minimum standard, 

the essential learnlnij : d'Acomes of the : s(^ cunriculiimv be engaged in 

piann<9d learning activities for a high percentage of :the allocated time and effective class- 
room management establishes a productive/ work^^^ 

5. Frequent Monitoring of Student Progress 

Feedback on student acWevemem progress -rs frequently obtained Multiple assesisment 

methods, such as teacher-made tests, samples of student's work, mastery skills checklists, 

criterion^referericed tests^: and :r 

are used to Improve individual student perf<xmiajic^^ 

program. 
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Definition of on Effective School 

If effective echools commonly possess the characteristics Icientified, how then is an effec- 
tive school defined. Tfie steering committee proposes the following definition: 

An effective school is one in which all students learn the specified curriculum, regardless 
of factors In their background which have ordiiiarity been identified as those which prevent 
such learning. 

The definition of an effective school rests on four assumptions: 

The first assumption \9 that the primary purpose of schooling in our society is teach- 
ing and learning* Although schools hav0 other competing alternative functions, cuch as 
providifKj custodial care for the community and providing evaluative data to future employ- 
ers and to institutions of higher education, these responsibilities must not sublimate the pri- 
mary mission. 

The second assumption Is that the degree of a schooPs effectiveness must be judged 
In terms of student output data, primarily student achievement measures. Through var- 
ious accreditation processes, schools are often judged by the nuinber of books in the li- 
brary, the availability of curriculum guides, the certification of jts teachers, or the quality of 
its teachers. Certainly, these are important areas; however, ultimately the effectiveness 
must be judged on measurafcde student outputs. Today's public is not satisfied with "Our 
school is doing a good job." They want schools to be accountable and to have proof of that 
accountability. 

The third assumption la that an Effective School is one which demonstrates both 
quality and equity in Its student outputs* The determination of quality is associated with 
the overall high level achievement of students. Equity is based on the befief that all stu- 
dents can demonstrate school success, especially when success is defir^ed as mastery of 
the essential curriculum. The determination of equity is associated with the analysis of pupil 
achievement to ensure equitable distribution of that achievement across student subgroups. 

The fourth assumption Is that there are many things over which the school has con- 
trol that can significantly influence student achievement. A school cannot alter the edu- 
cational level of parents, the socioeconomic status (SES), nor the Intelligence quotient of a 
Child. However, working together, the school staff and community can unite to influence 
such factors as school climate, expectations, schoblwlde emphasis on academics, Instruc- 
tional leadership, and frequent monitoring of pupils and programs. Ail of these factors, re- 
search shows, correlate with high student achievement. 

As the late Ron Edmoncs so eioquentiy stated: "We can» whenever and wherever we 
choose, successfully teach all children whose schooling is of interest to us. We already 
Icnow more than wa need in order to do this; Whether we do it must finally depend on how 
we feei about the fact that we haven't done it so far/' 
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Mission of the Mishowoko Schools 

According to Dn Lawrence Lezotte of Michigan State University; straightforward answers to the 
following two questions should t>e emt>raced »i the school*s mission statement or concomitarrt 
curricular goals and priorities: 

1. "What do we want our students to know and be able to do when they complete their K~12 
schooling?" and, 

2. "How many students do we e^qiect to learn what it is that we want them to know and be 
able to do?" 

These questions, and acceptance of the following propositions as both reasonable and possible. 
iom the framework for the mission statement of the School City of Mishawaka and its curricular 
priorities: 

Proposition 1 

The primary goal of public education is to empower students with choices. Restated, the goal of 
K~12 schooling is to give as many students as possible as many options as possible for choosing 
what they might do after the twelfth grade. 

Proposition 2 

The primary function of schools is teaching and learning. The empowering of choices is assumed 
to derive from what students are taught and what students learn* Therefore, the centering focus of 
the schno! derives from its program of curriculum and instruction. 

Proposition 3 

The primary evidence for establishing the effectiveness of a school is to be found in its student 
oiitcomes. It's essential to provide solid evidence which verifies that students, in fact, are learning 
what it is we want them to know and l>e able to do. These outcome indfcators should be observ- 
aole and measurable to assure pupils, teachers, psu'ents, or the community that students are mas- 
tering the essential curriculum. 

Proposition 4 

In the final analysis, the effective school is a school that is successful in teaching all of its stu-^ 
dents the essential skills they need to know or to be able to do. The focus of each effective 
school is on quality and equity. The outcome indicators selected to demonstrate student achieve- 
ment should reflect with accuracy the curriculum being taught. In addition, the outcome results 
should be examined in such a way that educators can be certain that no major subset of the 
student population is left behind. 

These propositions form the basis for the following mission statement for schools in the School City of 
^/lishawaka* 

The School Gty of Mishawaka believes that all students can learn mastery of bash skills and that it is the 
msponslblOty of school employees to teach aH students the specified curriculum at each grade leveL The 
mission of the School City of Mishawaka, therefore, is to educate all students to their highest level of aca- 
demic performance, while fostering positive development of their health, their attitudes, and their behaviors, 
A) that each indivkiua! student may make a positive contribution to our democratic society. 



IN MISHAWAKA, ALL STUDENTS WILL LEARN 
SCHOOL CITY OF MISHAWAKA 
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SCHOOL IMPROVEMENtf LAN 
—1986-87 YEAR ONE-^ 

September ' 

• Data cornplefecl for each student for disaggregated iahalysiis oif test scores by $e(Hember 26, in 
order to encode for standardized tests admbistered to Iseleci^^^^^ in latie September 
arid "earify October. " 

Octbber . .• . 

• October 29. 1986— Development Day with studerfts dismissed. 

• Staff surveys of effective schools characteristics conducted for each school and address by Dr. 
Lawrence Lezotte to entire professional staff. 

November 

• Assessment questionnaire completed by noncertified staff, selected parents, and selected stu- 
dents. 

December 

• Building-level improvement team formed in each school prior to December 19, and names re- 
ported to superintendent. 

• One member of each school-level improvement team designated by the team to be its repre- 
sentative to the systemwide improvement team, and name reported to superintendent by De- 
cember 19* 

January*February 

• Orientation and training of building-level improvement teams. 

• Profile of each school developed based on surveys and standardized testing, 

• District-level team meets to determine roles and responsibilities. 

March 

• Development of preliminary draft of school Improvement frfan for each school. 

• March 27, 1987— Staff Development Day with students dismissed. 

• Discussion of preliminary draft for school improvement in each school 

April 

• Refinement of each building-level plan and discussion of possible action plans. 

• District-level team meets to begin preliminary planning for updating district Improvement plan for 
1989-90 year. 

May ■ ■ 

• Each faculty reviews, revised, and approves final written school improvement plan for submittal 
to superintendent on or prior to June 1, 1987. Each plan should include indicators for measur- 
ing outcomes, c st estimates, time required anchor staff development requests. 

• District-level team meets to make final district improvement plan for year four, 1989-90, 

June 

• Each bufldiftg sut)mits Its final plan to superintendent for approval. Superinterident reviews and 
submits to the school board, with accompanying summarized cost and time estimates, for its 
approval. 
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— 19e7-8a YEAR TWO— 



• implementation of year bne building-jevel plan in individual buSdings with contin- 
ued support and encoiidigemdnt from centrai office. 

• Complete update of disaggregated analysis of standardized test scores, 

• Continue utilizing district and buliding-ievel teams to suppoit tmpiementation of 
txjilding-ievel plans- 

• Implement staff development programs necessary to support accompiishment of 
buildihg-level plans. 

• Continue curriculum cycie to develq;) iaiigned curriculum. 

• Utilize disaggregated analysis of test results to plot student achievement and 
monitor building growth toward equitable teaming environment. 

• Complete evaluation of twildihg plan, analyze test results, and re-evaluate build- 
ing-level needs assessment to develop updated building-level plans for the com- 
ing school year. 

• Develop new building-level plan for approval by the superintendent and board of 
school trustees for implementation during the school year I988~8g. 



--198fr-89 YEAR THREE— 



« Implementation of year two building-levei plan in individual buildings with contin- 
ued support and encouragement from central office. 

• Complete update of disaggregated analysis of standardized test scores, 

• Continue utilizing district and building-level teams to support Implementation of 
buildlng^level jplans. 

• Implement staff development programs necessary to support accomplishment of 
bullding*teyel plans. 

• Continue cun'icufum cycle to develop aligned curriculum. 

• Utilize disaggregated Wiajh/sis of test r^utts lo plot student achievement and 
monitor building growth towarid ^uitable^^te^ environment. 

• Conduct new needs assessment; analyze test results, and evaluate results of 
buiiding-level plan in brder to generate data related to current school needs. 

• Develop new building-level plan for approval by the superintendent and l3oard of 
school trustees for implementation during the school year 1989-90. 
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San Pasqual Union School District 

Became involved In Effective Schools process in 1986 



Community 


School District 




Population 


Enroilm#nt 


Ar«a (In $quar« mil^s) 




500 registered voters 


217 


30 




San Pasqual, located 30 miles 


Ethnic Composition (p#rc#nt) 


Schools 




northeast of San Diego. San 


Asian-American 9 


Elementary school (K-8) 1 


Pasqual Valley is largely 


Caucasian 66 






agricultural. 


Hispanic 35 






The residents are predominantly 


P#r Pupil Exp#nditur# 


Number of Staff 




middle class, with 65-70 percent 


1988-1989 $3,105 


Administrators 


1 


of the children coming from 




Certified teachers 


10 


families that are professional. 




Support staff 


7 


semi-skilled or skilled; the rest 








come from mostly unskilled 




Stud«nt-T«ach«r Ratio 




families engaged in agriculture. 




Elementary 


24:1 


Only 1 percent receive Aid to 




Middle/junbr high 


26:1 


Dependent ChiWren. The school 








distrtet is in San Diego County, 


P«rc«nt bu$$»d 


P«rc«nt coll«g«-bound 




which shares a border with 


100 


NA 




Mexico. 









Abstract 



San Pasqual Union School District is the only 
one-school district represented in this collection 
of case studies. Largely because of the less 
complex nature of a one*school district, San 
Pasqual's planning and implementation of the 
Effective Schools process has proceeded more 
smoothly than most larger districts. The district 
has also made good use of the San Diego 
County Office of Education's consultants and 
facilitators over the two years of implementa- 
tion. 

As a result of learning well the Effective 
Schools process for school improvement San 
Pasqual has integrated a school-wide staff de- 
velopment program with the student monitoring 
system. Teachers pkan for their training and 
focus on workshops which will help them under- 



stand the connectbn between the district mis- 
sion statement and instructional decisions. 

Because of the confusion which existed in 
the district (school) about teaching objectives, 
many teachers were not certain of what was 
actually included as core objectives for instruc- 
tion. The curricular alignment process which fol- 
lowed, in which teachers collaboroted to dis- 
cuss tests and then formed the continuum of 
teaching objectives, is detailed in this case 
study. The subsequent process of curricular de- 
velopment, especially in the area of mathemat- 
ics, is also described. 

The strengths and limitations of a small one- 
school district are described, and strategies are 
offered to meet the demands of implementing 
the Effective Schools process consistently. 
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Brief Look at San Pasqual^ 

San Pasqual Union School District is located in 
north San Diego County about 30 miles northeast of 
the city of San Diego. The small K-8 school sits on 
the north side of the San Pasqual Valley, an agricul- 
tural reserve and site of the only California battle 
fought in the Mexican-American War. The original 
two-room school was built in 1918. These two rooms 
served the valley until 1970 when the current facility 
was built. The school still shares its site with an In- 
dian graveyard. This peaceful rural valley, however, 
now abuts the rapidly growing city of Escondido. Ap- 
proximately 30 percent of the school's 217 students, 
in fact, attend San Pasqual on interdistrict transfer 
permits. The school's population is 30-35 percent 
Hispanic in origin, coming mostly from i-^mi-skilled 
and unskilled families who work on nearby farms. 
The other 65-70 percent of the student population 
comes from middle income, professional, semi-profes- 
sional, or skilled families who work in a variety of 
professional and white collar jobs. A few families 
farm in the valley. Only one percent of the families 
receive Aid to Families with Dependent Children. 

The enrollment of the school has steadily increased 
over the last few years so that there is now one class 
and one teacher per grade level. The staff consists of 
teachers, a retired teacher who serves as the librarian, 
an eighth grade algebra teacher, the school's PE 
teacher, and three classroom aides hired with Chapter 
1 and State of California School Improvement funds. 
The kindergarten teacher works as a reading specialist 
in the afternoon. 



Motivation for Launching the 
Effective Schools Program 

The school has undergone some difficult personnel 
transitions in the last few years. In 1986 the Board of 
Education terminated the contract of the superinten- 
dent-principal; however, this person was retained as 
the kindergarten teacher and business manager, and 
still held the title of principal for the duration of the 
year. One board member resigned from the board and 
applied for the position. He was hired as the new su- 
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^The authors wish to thank J. Gordon Christensen, Superintendent- 
Principal of San Pasqual Union School District and the teachers— 
Brycc Bacher, Wynooa Bchling, Patricia Gammic, Karalee Gorham, 
Maiydee Hinrichs, Diana Kirby, Patricia Matson, John Mayo, Jane 
TnisscI, Victoria Young— and the staff of the school— Steve 
Bostrom, Candi Gates, IJnda Govatos, Bob Johnson, Dee Petinak, 
Udia Quiroz, and Lola Rosas— for allowing us to tell the stoiy of 
their itnpcovement efforts. All of them are dedicated educators who 
have worked especially hafd in the last two years to strengthen the 
quality of the educational program for all children at San Pasqual. 



perintendent-principal in the spring of 1986. This 
course of events caused considerable tension and con- 
fusion among staff members, even though the new su- 
perintendent displayed considerable diplomatic skills, 
and all were trying to make the best of an awkward 
situation. 

The new superintendent-principal decided the time 
was ripe to take stock of school programs, solicit 
views of students, staff, and community, and to assess 
student achievement. He contacted the San Diego 
County Effective Schools Program, which offered an 
appropriate vehicle for helping the principal in this 
task of assessment. The county's program consists of 
the following components: data collection, data analy- 
sis, development of an improvement plan, implemen- 
tation, and reassessment. The data collection involves 
information collected through the following means: 
San Diego County Effective Schools Surveys for 
staff, parents, and students; an Effective Schools in- 
terview for staff members; the Association for Super- 
vision and Curriculum Development Organizational 
Health Descriptive Questionnaire; classroom time-on- 
lask audits; and a disaggregated analysis of test 
scores. 

After the county office shared all of the elements 
of the Effective Schools program with the principal, 
he was eager to begin. The next step was to conduct 
an orientation for the staff and allow them time to 
discuss the merits of launching an Effective Schools 
assessment and improvement program. Several staff 
members were reluctant. They %vere uncertain how the 
information would be interpreted by the former prin- 
cipal. Also they thought they did not know the cur- 
rent principal sufficienlly well to complete the sur- 
veys. However, it was pointed out that there was a 
"don't know" response that they could use in com- 
pleting the survey to address those areas where infor- 
mation was lacking. The principal was able to per- 
suade the staff that he genuinely wanted their views 
and that he wanted a good data base to guide their 
improvement efforts. In December 1986 the Organiza- 
tional Health and Effective Schools staff surveys were 
administered, and the interviews conducted. In Janu- 
ary 1987 the parent and student (upper grades only) 
surveys were completed. Also, the teachers were 
trained to conduct the time-on-task audits. Although 
they had enjoyed the visits to each others' classrooms 
during the training sessions, the staff decided not to 
do the audits themselves. Thus, county office staff as- 
sisted in this part of the assessment as well. The 
school staff was not functioning as a team yet, and 
previous tensions were too near the surface to risk ob- 
serving each others' classrooms in a formal way with 
data being recorded. 
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At the end of January, once all the data had been 
collected, an all-day planning day was organized for 
the staff. The staff spent the morning working in 
small groups, with each group analyzing all the data 
for two different correlates. Each team identified 
strengths and targets for improvement by doing item 
analyses and comparisons from the different surveys. 
They also disaggregated test data from the California 
Assessment Program (CAP). 

Some of the data are summarized in Graphs 1-4. 
Graph 1 presents the responses to the Effective 
Schools Surveys from teachers, principal, and classi- 
fied staff. This graph shows that the views of the 
teachers and classified staff are not as positive as the . 
principal's, especially in the areas of instructional 
leadership, clear school mission, and frequent moni- 
toring. On the whole the responses of the classified 
staff are much less positive. An item analysis re- 
vealed that for many items, respondents marked 
**don't know.** In discussing the data, a critical ques- 
tion for the staff was (1) what do they need to know 
and (2) how can they be kept better informed. 

Graph 2 presents the responses of parents and stu- 
dents, which show good support for the school. The 
students, however, view the school less positively. 
Graph 3 depicts the composite results of the time-on- 
task audits. This snapshot of audits revealed a rela- 
tively high time-on-task percentage of 87 percent and 



a higher than average interactive time allocation of 55 
percent. Graph 4 shows some of the disaggregated 
test data that were shared with the staff. This graph 
shows that students whose first language is not En- 
glish do not do as well as English-only students. 

In the afternoon the staff turned their attention to 
developing a school-wide discipline plan since this 
was one of their top priorities based on the needs as- 
sessment data. Dr. Sammie McCormack from the San 
Diego County Office of Education assisted them in 
developing a school-wide positive discipline plan. By 
the end of the day the staff had a good understanding 
of the Effective Schools data, had outlined a school- 
wide discipline plan, and had decided that one of the 
next tasks would be to develop a mission statement 
for the school. Table 1 is a sample page from the San 
Pasqual Effective Schools Assessment Summary Re- 
port that presents data on the clear school mission 
correlate. It illustrates how strengths and targets for 
improvement are identified and why formulating a 
clear school mission was chosen as one of the areas 
for attention. 

The staff morale soared at the conclusion of this 
day. Many commented that it was gratifying and re- 
warding to be focusing on school programs and stu- 
dents. They reported that they had not worked to- 
gether like this as a staff for a long time. The 
Effective Schools process proved to be a healing one. 



GRAPH 1 : Comparison of 1986 Principal, Teacher and Classified Survey Results 
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Graph 1. Comparison of 1986 Total Results 
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GRAPH 2: Comparison of 1986 Parent and Student Survey Results 
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Graph 2. Comparison of 1986 Parent & Student Results 



GRAPH 3 

Results of 1986 TIme-on-Task Audits - San Pasqual 
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Graph 3. Results of 1986 Timc-on-Task Audits 
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GRAPH 4: Comparison of CAP Scores Based on Unguage Fluency 1987 Results 
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Graph 4, Comparison of 1986 CAP Scores: Disaggregated Analysis 



enabling the staff to overcome previous divisions and 
mistrust. 

In February the superintendent-principal, a board 
member, and a staff member attended the county's 
Effective Schools Conference where they heard Larry 
Lczotte and Robert Fortenbcrry. They also learned 
strategies first hand from other San Diego County 
principals and staff members who were implementing 
school effectiveness programs. Participating in this 
conference helped the staff to understand more clearly 
school effectiveness goals and processes. Later that 
spring McCormack reviewed and refined the positive 
discipline plan with the staff and conducted an eve- 
ning workshop for about 50 parents to explain the 
discipline plan and give parents tips for positive inter- 
actions at home. Several staff members attended.* By 
late spring the principal and staff had developed a 
mission statement. 



Funding 

The Effective Schools assessment and assistance 
services are provided free to San Diego County 
Schools. The estimated cost of the personnel time and 
services is approximately $1,500 to $2,000 per school 
per year. General fund monies provided the release 
time for the staff to learn to conduct time-on-task au- 
dits, attend the Effective Schools Conference, and 



other selected inservice activities. The staff inservice 
day and several staff meetings were devoted to school 
improvement. 

In the second year of the school improvement ef- 
forts some funds were allocated to achieve the 
schoors goal of improving their mathematics pro- 
gram. Funds, including contributions from the Parent- 
Teacher League, have been spent for math materials, 
a staff development consultant in math, and atten- 
dance at math conferences by staff members. The al- 
location, however, did not exceed $2,500. State text- 
book funds were used this past year to acquire a new 
math textbook. The San Diego County Office of Edu- 
cation again provided free ongoing support and con- 
sultant services. The principal has actively and sym- 
bolically supported the program by his allocation of 
time to classroom observations, attention at faculty 
meetings to instructional issues, and follow through to 
see that the goals set by the staff are carried out. 

For the past two years the school has participated 
in the California School Improvement Program and 
received $6,000 in state funds. Most of the entitle- 
ment money funds classroom aides, with a small por- 
tion going toward instructional supplies. The school- 
based improvement program permits the staff to hold 
a staff inservice day and collect Average Daily Atten- 
dance funds generated as though the students were in 
attendance. Though it is customary to develop a writ- 
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- : Cie^arSthoo] Mission 

• lOO 'perceht c^^^^^^^ surveyed agreed 
or s|:rof>gly agreed that academic cbhlevemef^^ . 
Is stressed .' as the : highest prtortty ; in the 
scHoo!.':' ■r'"'.^ 

• 92 percent of ihe parertts suiv^id' indicated 

^ that ..their cHffdren understand that essential : 
academic siklils is the ihh^^ gbal cif 
V .88 percent of the^^ surveyed iaSgre^^ or 

strbrigly iagreedyi^^^^ 

goafe of Sian f^SlsqUal elementary siftobL -■■ 

• 98 pe^bent 'ort^^^ surveyed Indicated 
that, the sclx3oi^;: j^ the necessary text- 
tx)oks; ;ahd^; m^^ support the school's 
instructional program ; 

• 74 percent of the students surveyed Indicated 
t^)st teachersf explain what they will learn in 
each of the courses/ 



Targets of Improvement: Strategies for 
Improvement 

• 26 per(>ent of the teachers sun/eyeo irldlcated 
■that the echobl has a written statement of pur- 
pose that focuses on student learning and 
achlevemer)t 

• 88 percehit of the teachers Inten/iewed 
: strongly disagreed that there is a written 

statement of fxirpose that guides instmctional 
decisions. 

• Up to 50 percent of the teaching staff were 
uncertain as to whether written standards of 
expected student achievement exist In all 
major bofitent areas. 

• 38 : |>erc«nt of the teachers surveyed dis- 
agreed that students must achieve Identlfiad 
standards in all subjects. 



ten plan, the school in these first two years has used 
the Effective Schools data to guide its improvement 
efforts. 

Evidence of Improvement 

The school administers two norm-referenced tests, 
the California Assessment Program (CAP) given to 
third, sixth, and eighth grade students in the spring of 
each year, and the Comprehensive Test of Basic 
Skills (CTBS) given at each grade level each spring. 
In 1988 was the first time that eighth grade students 



also tooic the direct assessment of the writing portion 
of the CAP. Individual teachers use chapter tests to 
assess mastery of class work, and a minimum compe- 
tencies/proficiency tests are given at fourth, sixth, and 
eighth grade. The proficiency tests were developed by 
the district. No comprehensive criterion-referenced 
tests are given. 

With such small sizes, the CAP, a matrix sampling 
test, presents some problems in providing valid data. 
The state test is useful, however, because test data are 
disaggregated by family income and language profi- 
ciency. The language proficiency data provides a rea- 
sonably accurate measure because there are sufficient 
numbers of students in each subgroup. The CTBS is 
taken by every child, but the data are not reported to 
the school in a disaggregated form. The school had 
previously not disaggregated these results. In 1987 the 
disaggregated eighth grade CAP test results show that 
there are considerable inequalities in achievement be- 
tween the Hispanic and English-only students in read- 
ing, written language and mathematics. Graph 5 illus- 
trates these disparities. 

As described in the previous paragraph, in tlie sec- 
ond year of the improvement program, the staffs 
focus has been on improving math instruction and 
achievement. The 1988 CAP and CTBS results indi- 
cate that the goal was achieved. Graph 6 shows the 
CTBS m.ath results for 1987 and 1988. Gains were 
made at all but two grade levels. Graph 7 shows the 
comparison of 1986-1987 and i987--1988 in all areas 
tested by CAP at the third and sixth grade levels. 
Gains were made in math at both third and sixth 
grade. The disaggregated results are encouraging for 
sixth, but less so for third, as shown in Graph 8. 
Graph 9 shows that when the CTBS math results a-'c 
disaggregated by quartile, the second, sixth, seventh, 
and eighth grade results are very positive for the low- 
income Hispanic students. At the 7th and 8ih grade 
levels no students scored in the bottom quartile and 
only a few in the second quartile. Unfortunately the 
disaggregated results are less encouraging at some of 
the earlier grades. One explanation for this, based on 
other studies of schools serving lim'.ed-English profi- 
cient students^ is that it takes until fifth or sixth grade 
for the students' English to be sufficient for them to 
show gains more equivalent to English-only students. 

The language arts portion of CTBS and CAP 
showed promising gains both in overall achievement 
and in disaggregated results. However, in reading 



Pollack, S., Chrispccls, J., and Watson, D. (1987). A Descripdon of 
Factors and Implementation Strategies used by Schools in Becoming 
Effective for AH Students. Paper presented at \ho Annual Meeting or 
the American Educational Research Association Meeting, Washing- 
ton, D.C. April 1987. 
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GRAPH 5: Comparison of 8th CAP Scores based on Language Fluency 1987 Results 
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Graph 5. Comparison of 8th Grade CAP Scores, 1987 



considerable inequality of results exists between sub- 
groups of white and Hispanic students. 

The 5^chool has three aides, and this past year, a 
pirl-time reading specialist, who assist students with 
the greatest need. However, according to the Effective 
Schools Research, the pullouC programs are disruptive 
to the regular program. Furthermore, the school does 
not have a bilingual teacher or a bilingual program 
for its Hispanic students. Next year's improvement 
target will be in the area of reading c^nd language arts 
with plans to implement a home reading program and 
to reevaluate the pullout programs. 

In addition to test score data, the Schoo) Effective- 
ness Survey represents another measure of change. 
The survey for the staff was readministered in June of 
1988. Graph 10 compares the results of principals and 
teachers in 1986 with those of 1988. 

One should note two important changes in the 
school. First, the principal and the teachers have 
moved closer together in their views about the school. 
Second, substantial improvements have been made in 
three of the correlates: instructional leadership, clear 
school mission, and frequent monitoring. Also, there 
has been a small gain in the area of high expecta- 
tions. In the recent survey, the staff results reflected 
less uncertainty and greater approva' of the 
principalis leadership. For example, the 1986 survey 
results show that 75 percent of the teachers were un- 
certain and 25 percent disagreed that the principal 



provided clear, strong, and central instructional lead- 
ership. In 1988 the survey results showed only 22 
percent of the staff members were uncertain and 11 
percent disagreed regarding the principal's leadership. 
Qear school mission has been enhanced by the devel- 
opment of a mission statement for the school that fo- 
cuses on enabling all students to develop skills, goals, 
and dreams. In the area of frs'^.quent monitoring, an 
item analysis of the surveys shows that changes have 
occurred in regard to using test results to plan for 
making reteaching and remediation an important part 
of instruction. These three correlates have received 
the most attention, and they reflect the greatest gains 
in terms of a positive opinion shift. 

Graph 11, a comparison of the classified staffs 
views in 1986 and 1988, shows a shift in attitudes. 
The parents and students were not resurveyed in 1988 
and no comparative data are available. 



Influence of Effective Schools 
Process on Program Components: 
Curriculum Alignment 

The Effective Schools correlates gave the focus 
needed to continue San Pasqual's school improvement 
process into the second year. With the staff believing 
that the school is a major determinant of achievement, 
they formulated a plan to implement interventions in 
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GRAPH 6: Comparison of 1987 and 1988 CTBS Math Results - San Pasqual 
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Graph 6. Comparison of CTBS Math Results, 1987, 1988 
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GRAPH 7: Comparison of 1987 & 1988 CAP Test Results for San Pasqual 
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GRAPH 8: CAP Test Results 1988 Disaggregated by Family Profession 
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Graph 8. CAP Test Results 1988, Disaggregated Analysis 



GRAPH 9: Distribution of students Scoring in Each Quartile on CTBS Math 
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the curriculum. Curriculum alignment in mathematics 
was targeted as a need because of the adoption of a 
new textbook scries. The survey data also indicated 
not all staff members were in agreement thai instruc- 
tional objectives were in place and that written stan- 
dards of expected student achievement existed. 

The school staff spend two afternoons looking at 
all the variables that make a difference in student 
learning, i.e., what teachers choose to teach (instruc- 
tional objectives); how it is taught (instructional 



methodology); and the order in which things are 
taught (sequencing and timing). To strengthen the K- 
8 mathematics program, the following steps were car- 
ried out: 

Step 1: Review the Objectives and 
Benefits of Curriculum Alignment 

The curriculum alignment process focuses on de- 
fining the core sol of leaching objectives that ail stu- 
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Graph 10: Comparison of 1986 & 1988 Teacher and Principal Survey Responses 
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Graph 10. Comparison of 1986-1988 Principal's and Teachers* Responses 



GRAPH 11 : Comparison of 1986 & 1988 Classified Staff Survey Responses 
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Graph 11. Comparison of Classified Staff's Responses, 1986 and 1988 
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cJents a-re expected to master, selecting appropriate 
materials and strategies that will insure mastery, and 
using appropriate tests to measure the level of student 
mastery. The teachers examined reports and statistics 
which indicated that the current mathematics text- 
books had voids in providing lessons that prepared 
students for all test questions. Teachers noted that 
some questions asked on the norm-referenced tests 
covered material that was not presented in the texts 
until after the tests. In addition, they discovered that 
the format and appearance of problems in the text- 
book were quite different from the way the problems 
were presented on the tests. Teachers agreed that the 
material in the textbook could not be adequately cov- 
ered in the school year. They discussed the need to 
make informed decisions about what would or would 
not be covered. 

Step 2: Clarify the Objectives 
of the Instructional Program 

Primary, middle, and upper grade teachers grouped 
to examine a set of core objectives by grade level that 
were matched to the tests given to their students. All 
teachers had an opportunity to discuss the appropri- 
ateness of the objective, decide if it was important, 
and if they should teach it. Next they decided whether 
the objective should be to master by the year's end, 
and what percent of the students should achieve mas- 
tery. Several of the teachers concluded that they were 
not thoroughly aware of what was being tested. They 
also thought they were covering other objectives of 
equal importance that were not covered on the tests. 
However, they recognized that not all students were 
mastering the core objectives and that this presented a 
challenge. A core curriculum in mathematics was de- 
veloped for the school. 

Step 3: Establish the Top Instructional 
Priorities in Mathematics 

Teachers identified the top priorities of the instruc- 
tional program by performing an item analysis of the 
mathematics portion of the CTBS test. They identified 
the essential skills that every student needs to have 
and then established priorities for teaching and learn- 
ing. 

Step 4: Develop an Effective Instructional 
Plan for Teaching the Mathematics Objectives 

The teachers realized that they needed to plan the 
year's activities so that the objectives for the year are 
fully covereoi and mastered. The teachers recognized 
the need to schedule some lessons that appeared in 

erIc 



the back of the textbook eariier in the school year be- 
fore testing occurred. For example, one teacher ob- 
served that ration, proportion, and percent are not pre- 
sented until the end of the textbook, and that 25 
percent of the test items focused on this area. The 
teachers recognized that they were in charge and the 
textbook did not have to dictate sequencing and pre- 
sentation of the objectives. 

Step 5: Increase Math Competencies 
and Check Progress 

The staff adopted Bellworks, a set of sponge activ- 
ities, that follows the formatting, vocabulary, and se- 
quencing of the test items for which students are 
being held accountable. 

Step 6: Increase Instructional Skills 
of Teachers in Mathematics 

The staff scheduled a day-long inservice with 
Leigh Childs, county office mathematics consultant, 
and Merilyn Beck, mathematics coixsultant for the En- 
cinitas School District (Encinitas, CA). The consul- 
tants taught the staff cooperative learning strategies 
and higher level thinking mathematics lessons that 
would provide the instructional strategies to best sup- 
port the core set of objectives adopted by the staff. 
AlJ teachers committed themselves to trying out three 
new lessons in the classroom that supported the ob- 
jectives and the new state Mathematics Framework. 

Impact of Effective School Process on 
Disaggregated Student Achievement Data 

As mentioned previously, the CAP program does 
provide disaggregated student achievement data. 
However, this information is infrequently used by 
schools, and especially by the classroom teacher. The 
school effectiveness process has helped the staff to 
highlight the value of the data contained in the CAP 
report to the school. In addition, San Diego County 
Office of Education staff members have worked with 
the principal to disaggregate the results by Hispanic 
and white subgroups from the CTBS. This informa- 
tion gives the school a clearer picture of student 
needs. 

The school docs not have a system of criterion-ref- 
erenced tests, except for their proficiency tests. The 
smallness of the district and the lack of auxiliary staff 
preclude the district developing its own criterion tests. 
However, the superintendent-principal is planning to 
visit a neighboring district, Escondido Union Elemen- 
tary District, which docs have a complete criterion- 
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and norm -referenced testing program. If there is suffi- 
cient alignment between the texts and objectives of 
the two districts, the district may be able to use their 
criterion testing system. 

The Effective Schools surveys reveal that the dis- 
trict needs to devote more attention to the objectives 
and mastery standards expected in each subject and at 
each grade level. Attention has been given to mathe- 
matics this year. Language arts and reading are likely 
to be the focus next year. As the staff sets its learning 
objectives and aligns its curriculum, it will be in a 
better position to find appropriate criterion-referenced 
tests. 



Staff Development Programs 

As a result of the Effective Schools program, staff 
development is now viewed as one vehicle for imple- 
menting the improvement plan. Previously San 
Pasqual had no school-wide staff development. The 
one day set aside for staff development had consisted 
of teachers selecting a school or class they wanted to 
visit and spending a day there. Since San Pasqual had 
no needs assessment process, little data were available 
to guide the planning of a staff development program. 
Now with data from the school effectiveness surveys 
and data from analyzing the test results, the school 
has information to guide its staff development. 

Two important staff development changes have 
been implemented. First, staff members now have op- 
portunities to attend workshops and conferences 
linked to the improvement goals. For example, this 
year a staff member and the principal attended the 
Greater San Diego Math Conference to support the 
school's efforts in math. Second, two school-wide 
staff development days were arranged. The first 
year's focused on reviewing the school effectiveness 
data and developing a discipline plan; the second 
year's focused on mathematics, e.g., learning how to 
use manipulative, problem-solving, and cooperative 
learning strategies. In addition, a day was devoted to 
aligning the math curriculum. 

The principal has also made a substantial commit- 
ment to strengthening his own skills by participating 
in the California School Leadership Academy. This 
program provides 15 days annually of staff develop- 
ment for principals in such areas as vision, mission 
and goals, analyzing test data, curriculum and iastruc- 
tion, school climate, planning staff development, eval- 
uating staff, and home-school partnerships. The prin- 
cipal will participate in the second year of the 
program during the 1988--89 school year. This leader- 
ship program fully integrates the research on Effec- 



tive Schools and thus complements and supports the 
principal in his efforts to improve the school. 

Comparisons of the responses from the Effective 
Schools survey conducted in December 1986 with the 
results of the survey completed in June 1988 show 
that attitudes regarding staff development have 
changed. Some items reflect the changes that are 
summarized in Table 2. 



The School Improvement Process 

San Pasqual Union has only nine teachers and a li- 
brarian/resource/physical education teacher; therefore, 
the whole staff served as the planning team. The 
board of education has been fully supportive of the 
school's efforts. The principal has given periodic re- 
ports to the board regarding the school's progress and 
improvement plan. They have expressed their support 
by renewing the superintendent-principal's contract. 
The parents have been involved through input on the 
Effective Schools surveys. In general their views of 
the school are very positive. In the first year of the 
improvement program, parents were also involved in 
a workshop on assertive discipline. The parent group 
usually raises funds as one of its primary functions. 
However, as a result of the improvement efforts, they 
are being brought in more fully as partners. For ex- 
ample, next year one parent, who has a background in 
children's literature, will coordinate the school's liter- 
ature program. She will be spending three hours a 
week at the school reading stories to the students and 
assisting them in selecting reading materials. Other 
volunteers will be solicited for this program as well 
as for other purposes. 

In the fall of 1988 the school f taff and parents 
began preparing for the California State Program 
Quality Review which was conducted in the spring of 
1989. The review required a self-study conducted by 
staff and parents. The school effectiveness surveys 
and data formed the foundation for the self-study. In 
addition, the school staff examined in-depth curricu- 
lum and instructional practices. They compared the 
school's curriculum and instruction with the state's 
challenging quality criteria in six curricula and six 
school-wide areas. The criteria fully incorporate re- 
search from the Effective Schools and effective teach- 
ing literature. 

After the staff completed the self-study, an outside 
review team of two administrators from other nearby 
districts and a county office staff member spent three 
days at the school observing classrooms, interviewing 
staff and parents, and comparing their own findings 
with the school's self-study. The Program Quality Re- 
view (PQR) culminated in a Report of Findings. On 
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the afternoon of the third day of the review, the PQR 
team and staff met to develop an action plan. Three 
major improvement targets were set: language arts, 
visual and performing arts, and the special needs of 
students covered by state and federal programs such 
as low achieving students, limited-English proficient 
students, and gifted and talented students. The action 
plan details who, what, when and how the improve- 
ments in each of these critical areas will be made. 

The PQR team found that the school had made 
good progress in many areas, and they identified as 
strengths the Effective Schools process, the positive 
school climate, the alignment of the math curriculum, 
the clear school mission that focused on learning, and 
the leadership of the principal. The three year im- 
provement plan indicates that learning objectives need 



to be developed in language arts and in the visual and 
performing arts. Staff from the San Diego County Of- 
fice of Education will again assist the school staff in 
developing these curriculum objectives and engaging 
in curriculum alignment as they had done for math. 
The plan also states that the staff will need to work 
toward a literature -based reading and language arts 
program and to modify grouping practices, moving 
away from traditional reading groups organized 
around a basal reader. 

To better meet the needs of its limited English- 
speaking students, the review team recommended that 
the school focus future inservices on the acquisition 
of second language skills, visit schools implementing 
the English for Limited-English Proficient Students 
Program (ELEPS), adopt and implement the ELEPS 
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program, and attend conferences on the writing pro- 
cess. 

The review process confirmed the gains the school 
had made during the previous two years and com- 
mended the staff for their efforts. The self-study and 
review also set some clear targets for future growth, 
thus keeping the school effectiveness and improve- 
ment momentum going. 

Personnel Evaluation System 

In California, the personnel evaluation system is 
spelled out in state law. The number of formal obser- 
vations is specified as one every other year. The law 
also defines the procedures to be followed. Each year 
teachers write two to three objectives on which they 
will be evaluated and state what evidence will be col- 
lected to demonstrate accomplishment of the objec- 
tives. At San Pasqual, the principal does not make 
formal observations other than those specified by Cal- 
ifornia law. Teachers are uncertain whether or not the 
principal plans with teachers what will be observed 
and adequately discusses the observations in a post- 
observation conference. However, the staff agrees 
(100 percent) that the principal makes frequent con- 
tacts with students and teachers, is highly visible 
throughout the school, and is accessible to discuss in- 
structional matters. Another change since the imple- 
mentation of the Effective Schools program is that 
faculty meetings frequently focus on instructional is- 
sues; 78 percent agree and 22 percent are uncertain. 
Previously 38 percent had said instructional issues 
were not a focus and 50 percent said they did not 
know. 

The principal reported that he has changed person- 
nel evaluation practices in two ways. First, when he is 
observing classrooms, he now looks for much more 
than just an orderly, neat classroom with attractive 
bulletin boards. He is more alert to how time is used 
in the classroom. He observes instructional practices 
more carefully. He is on the lookout for equality of 
treatment by the teacher among all students. Second, 
the principal said that now when he has the opportu- 
nity to select new staff members, he is looking for 
different skills, and for teachers that have some 
knowledge of the Effective Schools literature and 
practices. 



Problems, Issues, and 
Concerns Encountered 

Once the initial concerns of the staff were ad- 
dressed, the school effectiveness efforts have met few 
obstacles at San Pasqual. However, the small size of 



San Pasqual contributes both strengths and limits as 
the district tries to implement its Effective Schools 
program. One asset of smallness is that it facilitates 
communication. Once a direction has been set, com- 
munication about the direction and monitoring are rel- 
atively easy tasks. Involvement of the whole staff is 
possible thereby greatly increasing ownership of the 
plan and speeding implementation. The small number 
of teachers means that it is easier to plan and coordi- 
nate a K--8 curriculum. On the open-ended comments 
of the school effectiveness surveys, the small size was 
mentioned by many parents and staff as a strength of 
the school. 

However, the small size poses some problems as 
well. Few extra staff members are available to take 
on additional work. In particular San Pasqual has no 
specialists in the district who can assist the staff. 
They must rely on the outside assistance of the 
county office staff or other consultants. The superin- 
tendent-principal must do all of the school paperwork 
as well as attend to the district administrative tasks. 
Resources, both staff and budget, are limited for 
meeting the needs of the limited-English proficient 
students. Currently the district allocates only one staff 
development day a year. This provides very little 
planning, training, and implementation time for staff. 
The school plans to expand its staff development time 
next year by increasing the school day by 15 minutes. 
The time will be devoted to sustained silent reading. 
The extra minutes generated will allow the staff to 
have two additional minimum days for staff develop- 
ment. 



Advice for Others Implementing 
a School improvement Process 

In guiding others in carrying out a school improve- 
ment process, the superintendent-principal advised se- 
curing the full support of the board of education. He 
found this support had a positive impact on the suc- 
cessful implementation of the school effectiveness ef- 
forts. 

His second recommendation is, "Focus on a do- 
able objective that everyone can rally behind." Given 
the fact that there were tensions and confusion among 
staff members when the process was started, it was 
important to undertake an objective that would bring 
the staff together and have some immediate effects. 
The success of implementing the school-wide disci- 
pline plan laid the groundwork for addressing curricu- 
lum and instructional issues in the second year. 

The third, engage the staff in an analysis of learn- 
ing objectives in a particular curriculum area and to 
spend time seeing that these objectives are covered in 
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their materials. Analyzing test items also proved ex- 
tremely useful for the staff. In larger school districts, 
it is more likely that this curriculum alignment activ- 
ity would be done by district staff. In San Pasqual, 
the school staff is the district staff. The exefcisc 
proved to be a valuable one and should not be over- 
looked by others as a helpful learning activity for the 
entire staff. 

Fourth, involve as many of the staff members as 
possible. If a small planning group had been in 
charge of the improvement program, the impact 
would not have been nearly as great. The size of San 
Pasqual made it ideal for involving the whole staff. 
Larger schools need to find strategies, like task forces 
or subcommittees, that insure that every staff member 
has some responsibility for meeting the improvement 
objectives. 

Fifth, utilize the resources of outside consultants 
who can offer an impartial voice and help guide the 
improvement efforts. The county office services were 
particularly helpful in San Pasqual's case. An impor- 
tant role of the consultant, in addition to bringing re- 
sources and information, is to be a sounding board for 
the principal or other staff members. 

Summary 

In the past two years, San Pasqual has made great 
progress in implementing its school effectiveness pro- 



gram. The board of education, the superintendent, the 
teachers, and the parents seem to be in agreement re- 
garding the goals of the school and district. The ini- 
tial resistance by the staff has yielded and all are 
pulling in the same direction. The staff has seen the 
payoff from its efforts in terms of higher overall 
achievement for students in mathematics and lan- 
guage arts, and important gains for its Hispanic stu- 
dents. With knowledge of these gains, the staff com- 
pleted the 1987-88 school year in high spirits. The 
challenge for the school next year is to carefully ex- 
amine strategies for teaching reading and to explore 
ways to be more effective in teaching reading so that 
all students master the basic skills. 

The school effectiveness process has shown the 
staff the importance of data and the value of using 
data to plan improvement objectives. The process has 
helped to target resources — people, material, funds, 
and staff development. Once resources and objectives 
are targeted, teachers will increase opportunities for 
student learning. 

The staff of San Pasqual now realizes that school 
improvement is an ongoing process. They can cele- 
brate how far they have come as well as work on the 
challenges that remain. The challenges are ones they 
know they can achieve. With careful planning and 
staff development the teachers know they can raise 
the achievement level of all students. 



Effective Schools Do 
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Jackson, Mississippi School District 

Became involved in Effective Schools process in 1980 
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From the beginning the superintendent and board 
of education gave leadership to and supported the 
school improvement process In Jackson. Mississippi. In 
the late seventies the Jackson Public Schools had 
completed a program which, over the previous de- 
cade, had attempted both desegregation and the 
unification of all school districts Into one system. In 
1980. the superintendent v^as seeWng a process for 
school Improvement built on a quality education and 
equity for all students, and asked Ron Edmonds to 
speak to teachers at a retreat. "The result of that 
conversation continues" through the present day. 

All district and school staff v^ere trained to have a 
good understanding of the Effective Schools corre- 
lates, with components of shared decision-making 
(school-based management), and administrators 
were given an Executive Training Program. Jackson 
was Implementing the Effective Schools process at a 
dlstrk:t level well before the mode! had developed to 
Include district retatlonshlps. (The early Effective 
Schools model was primarily Planned Change for Indi- 
vidual schools. A "Shared Governance Liaison 



*Statc Department accreditation Standards: 

Kindergarten — Standard 81: 22:1 

27:1 with teacher aide 

Grades 1-4 — Standard 83: 27:1 

5-6 — Standard 84: 30:1 (self-contained) 
5-6 — Standard 85: 33:1 (departmentalized) 



Committee" was put In place in Jackson to coordi- 
nate district decision -making, especially with regard 
to development of a unified curriculum.) 

In 1982 Jackson rewrote the personnel evaluation 
system (for teachers and for administrators) to focus 
on the correiates, especially Issues relating to Instruc- 
tional leadership, in 1985 an Instructional man- 
agement system (IMS) was Installed. After performing 
curricular alignment, teachers had written criterion- 
referenced tests for the district. Together with person- 
nel from the research and evaluation department, 
computer software was developed to assure fast 
grading and turn-around In grading these tests, so 
that the teachers had timely and accurate data to 
plan for reteaching and emphasis In future lessons. 
Jackson considers this system central to the improve- 
ment process, as they attempt to teach a uniform 
curriculum to all students. "All teachers are expected 
to follow the curriculum and are monitored by their 
principals. One of the areas in which the teachers are 
directly evaluated is implementation of the curricu- 
lum. Thus, failure to teach the curriculum Is insubordi- 
nation, not just disagreement with administrative 
guidelines." (From the case Study, p. 152) 

Jackson Public School District Is a district commit- 
ted to teaching all of Its students. The Effective 
Schools process promoted ownership of the new pro- 
cess by teachers with district support for risk-taking 
and innovation in teaching-learning strategies. 
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Making a Difference In 
Jackson, Mississippi 

Jackson, Mississippi, a city of more than 200,000, 
has a heritage of public education. Now Jackson is 
moving forward to excellence in education. The Jack- 
son Public School District educates approximately 
33,100 students in grades K-12, with approximately 
78 percent minority and 22 percent non-minority. 
About half of the students live in one-parent house- 
holds and close to 75 percent can be classified as stu- 
dents from low socioeconomic backgrounds. 

A five-member board of trustees appointed by the 
city council makes policy in the district which con- 
tains 37 elementary, 11 junior high and 8 senior high 
schools. In addition to these regular schools are four 
special schools: Alternative Elementary School, Alter- 
native Secondary School, Career Development Center, 
and the Academic and Performing Arts Complex, The 
school board oversees a budget of $100 million — 51 
percent from local taxes and 49 percent from state 
taxes. 

The struggle for excellence has not been without 
anguish. The late 1960s and early 1970s were fraught 
with desegregation and the unification of racially iso- 
lated districts into one school district. Making the 
change was painful, but it went smoothly. In the late 
1970s a serious, demanding examination of the 
district's instructional program began. By 1980 the 
superintendent was seeking, quietly and unobtru- 
sively, an answer to the question, "Can all children 
learn?** 

The question, **Can all children learn?'* was asked 
of everyone involved in the educational process. The 
responses in most instances were a resounding yes, 
but in a few cases the answer was yes with some res- 
ervations. School district leaders invited Ron Ed- 
monds to speak at a retreat for two teachers from 
every school who were elected by their peers. The re- 
sult of that conversation** continues through 1988. 

An instructional council comprised of a majority of 
teachers, elementary and secondary principals, and the 
instructional management team members, led by Rob- 
ert N, Fortenberry, butted the Jackson educational re- 
form movement. They worked together on several 
IBronts, 

The district was fortunate in having a biracial 
board of trustees that endorsed the belief that all chil- 
dren can learn. These same board members, under the 
leadership of board chairman Rowan Taylor, when 
apprised of the correlates of Effective Schools, sup- 
ported this philosophy without reservation and urged 
the district administration to move forward. This en- 
dorsement allowed the relocation of funds to imple- 
ment programs needed to support the correlates. 



School board leadership and support have made an 
important difference in what the district has been able 
to achieve. This support has come through testimoni- 
als, personnel assignments, and financial commit- 
ments. Local tax increases and prudent budget alloca- 
tions and expenditures have financed the Effective 
Schools process. 

Several programs that support the correlates were 
implemented and are presently ongoing. The first of 
Uiese programs was Shared Governance, a collabora- 
tive decision-making process involving teachers, stu- 
dents, administrators, and parents. This involvement — 
whereby decisions are the result of extensive 
participation by those affected — is not the final an- 
swer to all problems, but it enables the district to 
keep as its primary focus the welfare of all children. 

Teachers restructured the curriculum. They identi- 
fied what students need to learn in every subject and 
established a base-line curriculum. For grades one 
through six, teachers identified essential objectives 
each student must achieve to be promoted to the next 
grade. After one implementation and the gathering of 
much information, the teachers revised and realigned 
the curriculum. The district is now in a five-year re- 
view process which allows every subject to be stud- 
ied, reviewed, and revised within a period of five 
years. 

The Jackson Staff Development Program is being 
given greater emphasis. During the first year of Effec- 
tive Schools implementation, every person in the dis- 
trict became familiar with the Effective Schools cor- 
relates. Prior to their employment all new employees, 
especially new teachers, are trained in the philosophy 
and practices of the school district. The establishment 
of a common vocabulary and belief system keeps the 
focus on the teaching and achievement of all students. 
This is further carried out \yith an executive training 
program that provides special training for administra- 
tive candidates. 

The best indicator that change has taken place in 
the district is undoubtedly the data the district has 
collected. California Achievement Test (CAT) scores 
have increased, attendance is up, and the dropout rate 
is down — all during a dme when the district was in- 
creasing the standards. The disaggregation of data has 
provided the best indicator that all students are learn- 
ing, (See Figure 8) 

Figure 1 reveals at all levels a general decline in 
the number of students leaving school before complet- 
ing diploma requirements. Figure 2 shows a dramatic 
decline in grade 12 enrollment loss from 1979 
through 1986. In 1979 almost eight percent of seniors 
left school before the end of the year, while in 1987 
only slightly more than three percent did. 
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Figure 1. Dropout Rate 



District attendance information for the last four 
years is detailed in Figure 3 (percent average daily at- 
tendance or ADA). Highest attendance was registered 
at 95.3 percent average daily attendance in 1986. the 
year in which a very restrictive attendance policy was 
implemented, and the district-wide attendance has 
consistently remained over 94 percent each year. 

The CAT is the principal norm-referenced assess- 
ment instrument used by the district. Steady increases 
in CAT scores have occurred in the district. Figure 4 
reveals fourth grade CAT results from 1975-1985 and 
shows an increase in scores from the 26th percentile 
in 1975 to the 67th percentile in 1985. The greatest 
increases have occurred since 1980, the first year dis- 
cussion of the Effective Schools correlates began. The 
average percentile score on the total battery has risen 
from 41 to 67 during the six year period from 1980 
through 1985. 

A look at eighth grade CAT results for the same 
period of time (Figure 5) also reveals steady increases 
in average percentile total battery scores. From 1980 
to 1985, scores increased from the 38th to the 51st 
percentile. 

Figure 6 details increases in CAT percentile scores 
for grades 4, 6, and 8 at five-year intervals. The 
greatest increases in scores occurred at grade 6 with 
movement from the 28th to the 51st percentile, while 
fourth grade scores showed increases from the 26th to 
42nd percentile. Progress was also registered in eighth 
grade scores as they advanced to the 42nd percentile 
from the 28th percentile in 1975. 

In 1986 a renormed California Achievement Test 
was used in the district and scores declined somewhat 
on the renormed test. However, in 1987, it became 
apparent that educational progress was continuing. 
Figure 7 (CAT Scores: Grades 4, 6, 7, and 8) reveals 
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results for grades 4, 6, 7, and 8. Seventh grade per- 
centile scores showed the largest increases moving 
from 38.7 to 44.9 while increases for sixth graders 
ranked second as they advanced from percentile 
scores of 50.5 to 64.6. At all grade levels, scores con- 
tinued to move forward. In addition, the number of 
students achieving at the upper percentiles also in- 
creased. In 1987, 770 students scored in the 90-99 
percentile range as compared to 538 in 1986. 

The Effective Schools correlates permeate every 
area of the district and every facet of its operations. 
The leadership of the district has become committed 
to the philosophy that all children can learn and has 
placed the ultimate responsibility for student learning 
on the schools. The school board has amended district 
policies to bring them into alignment with the corre- 
lates, reallocated funds to implement necessary pro- 
grams, placed great emphasis on the training of certi- 
fied and classified personnel to insure a common 
knowledge base, and altered the personnel evaluation 
system to make certain that the behavior of every em- 
ployee will reflect the district's philosophy. Further 
evidence of the presence of the correlates can be seen 
in the development of and adherence to the district's 
five-year plan and the school improvement plan for 
individual buildings, both of which are constructed 
around the Effective Schools correlates. In looking at 
the correlate of safe and orderly climate, for instance, 
it is gratifying to note that 91 percent of the district 
students committed zero discipline offenses for the 
school year 1986-1987, while six percent committed 
only one offense. 

During that same year graduates of the district re- 
ceived more than $6.4 million in scholarship offers 
from such national prestigious schools as the U.S. Air 
Force Academy, Harvard, Yale, Duke, and Baylor. 
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Figure 2. Percent of Pupil Loss, Grade 12 
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Figure 3. Average Daily Attendance 
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GRADE FOUR CAT RESULTS. 1975 - 1985 
Jackson Public Schools 
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Figure 4. Grade 4 CAT Results 
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GRADE EIGHT CAT RESULTS, 1975 - 1985 
Jackson Public Schools 
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Figure 5. Grade 8 CAT Results 
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Seventeen seniors were named National Merit or 
National Achievement scholarship winners and al- 
most 81 percent of the spring graduates pursued 
advanced study. 

District programs received national recognition 
for excellence. The Jackson Public School Five- 
year Plan received the Award for Excellence from 
the American Educational Research Association. 
A Golden Achievement Award was presented to 
the office of Community Relations/Public Infor- 
mation by the National School Public Relations 
Association for its efforts in building community 
support for public schools. U.S. Secretary of Edu- 
cation William Bennett named the district Chapter 
I program one of 95 exemplary programs in the 
nation. And because of his strong leadership, Dr. 



Robert N. Fortenberry, superintendent, received 
Figure 6. CAT Percentile Scores the Executive Educators Top Administrators in 

America Award for a second time in 1985. 
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importance of Student Testing and Monitoring 
System to Jaci<$on Public Schools Succesis 

The influence of the Effective Schools process has been larjgely responsible for the non-optional, 
objective-based curriculum and the criterioh-feferenced unit tests developed by the distrtct. The 
leaders of the district wanted to ensure that all students, no matter what school they attend, would 
receive instruction measurable by unifonn standards. Implementation of the cu^iculum and tests 
were enhanced by the addition of the instmctibnal manageitient system which grades tests, calcu- 
lates attainment or non-attainment of mastery, and reports results to teachers, principals, and their 
superiors. In this way evaluation of the Instructional processes can be monitored by subject 
teacher, and school. : 

The distrtct continues to ex>.tTiirie test results to determine the effectiveness of its programs. After 
developing a uniform objective-based curriculum, preparation of curriculum-bJised tests began. 
Next, within the district both reliability and validity studies were conducted on the tests. Disaggre- 
gated analyses of norm-referenced and criterion-referenced test results have identified the student 
population the district is having the greatest success in educating as well as those students to- 
ward whom the district must direct more effort. Figure 8, for example, shows sixth grade CAT 
scores disaggregated by socioeconomic dass. race, and gender. Upper SES, non-minority fe- 
males and males showed the highest levels of success oh the test while low SES, minority males 
were least successful followed closely by low SES. non-minority males. Dialogue is continuing and 
plans are being made toward Improving delivery of services to the less successful student popula- 
tion. 



Grade Six CAT Scores:* Disaggregated by 
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Figure 8. Grade 6 CAT Scores, 1988 
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Instructional Management System 

The grading system is directly tied to the mastery 
of the curriculum. District-made unit tests arc used to 
measure student outcomes; the tests compose 70 per- 
cent of the student's grades each grading period. Stu- 
dents who do not pass the unit tests the first time are 
retaught the material and are retested. Students who 
pass the tests but fail to master some objectives are 
also retaught and are expected to provide evidence of 
mastery of essential objectives. 

To assist the teachers with grading tests and record 
keeping, an instructional management system (IMS) 
has Deen put in place. Objective tests are graded 
asing a scanner, and a print-out is provided for the 
teacher showing the test grade as well as mastery or 
non-mastery of each objective for each student. At the 
end of each term the system computes term grades 
and at the end of the year, final grades. The way in 
which grades are reported was also changed. Report 
caids were given a new format to show not only the 
numerical and letter grade, but also the number of ob- 
jectives taught and the number mastered. 



Importance of Staff Development System 

The thrust of the district's staff development pro- 
grams has focused on the correlates of Effective 
Schools and related concepts since the district began 
implementation in 1981. All employees of the dis- 
trict — both certified and classified — have been ac- 
tively engaged in staff development programs. 

The initial intent of the inservice programs was to 
educate all employees in the philosophy of the Effec- 
tive Schools movement to the extent that all staff 
members would become convinced of the cducability 
of all students. Initially 13 training modules were cre- 
ated to detail school effects research, the characteris- 
tics of an Effective School, and the development of a 
school improvement plan. Later the original set of 13 
modules was revised and consolidated into 4 modules 
requiring only 8 hours of training rather than 40. 
Thus, the training of employees new to the district 
could be accomplished more quickly and efficiently. 
Subsequent to the development of modules in Effec- 
tive Schools concepts, the district developed addi- 
tional material on effective instruction, teaching com- 
petencies, time managctnent, learning styles, and 
multicultural education. 

District leaders deliberately decided to involve 
classified employees in the district training in Effec- 
tive Schools concepts. Since over half of the district 
personnel are non-certified employees, their beliefs 
and behaviors have an impact on the individual 



school and district climate. Classified personnel at- 
tended inservice sessions with their various groups to 
ensure that they understand the focus of the district 
and the importance of their role in the district's mis- 
sion. 

A small cadre of trainers — using modules that em- 
ployed a videotape, overhead transparencies of the 
main points, a workbook of activities, and an objec- 
tive and process evaluation — learned to train others. 
These trainers instructed central office personnel, 
building principals, and a teacher from each school. 
The principal and a teacher then conducted staff de- 
velopment sessions at individual schools. At the con- 
clusion of each session participants were tested on the 
material that had been presented. Each school retained 
the videotape and related materials of the modules for 
future review and reinforcement. 

Preparation for implementing Effective Schools 
Research began in January 1980. The superintendent 
met with teacher representatives from each school in 
the district during a weekend retreat to discuss the 
focus of the district. At that work session the teachers 
nnd the superintendents decided on two vital compo- 
nents of the Effective Schools movement in Jackson: 
shared governance and a unified curriculum. 

The Jackson Shared Governance Liaison Commit- 
tee emerged as the district-level coordinating commit- 
tee for Effective Schools planning. Shared governance 
is a district decision-making process. Although all 
sides of issues are debated and discussed, voting on 
outcomes is not allowed. All final decisions and sub- 
sequent reports detailing those decisions must be 
reached by consensus. 

Shared governance consists of three types of com- 
mittees: (1) liaison committees, (2) ad hoc commit- 
tees, and (3) local school committees. The liaison 
committee, chaired by the superintendent, is com- 
posed of elected representatives of central office per- 
sonnel, building administrators, teachers, and parents. 
The committee addresses issues vital to the district 
and through ad hoc committees studies issues and of- 
fers suggested solutions and plans which are subject 
to approval by the school board. Ad hoc committees, 
composed of elected representatives from each school 
group, are established by the liaison committee for a 
limited time to study a single issue. Ad hoc commit- 
tees have provided direction in a number of important 
areas such as the certified evaluation system, grading 
system, attendance policy, and extracurricular activi- 
ties policy, to name a few. 

The local school shared governance committees 
consist of the principal and elected representatives of 
teachers, classified employees, parents, and, at the 
secondary level, students. Local committees usually 
develop the annual school improvement plan for the 
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school, although the principal may establish a sepa- 
rate committee to write the school improvement plan. 

The writing of the school improvement plan is 
based upon a review of the school's needs assessment 
and school profile. The needs assessment identifies 
areas in the school the faculty and staff wish to im- 
prove. The school profile is a compilation of statisti- 
cal information about the school including such areas 
as pupil enrollment, average daily attendance, disag- 
gregated standardized test results, course grades, pupil 
discipline, and dropout information. 

The school improvement plan committee addresses 
each of the correlates of Effective Schools as it writes 
the plan and includes a mission statement, school 
goals and objectives, problem areas, activities de- 
signed to improve the problem areas, methods of 
evaluating the attainment of objectives, and assign- 
ment of responsibility for each activity. Cnce the 
plans are implemented, they are monitored throughout 
the school year by the building principal. 

While the individual schools develop annual im- 
provement plans, the district develops a five-year plan 
as prescribed by the 1982 Mississippi Education Re- 
form Act. In annually updating the five-year plan, 
committees that represent various groups address the 
Effective Schools correlates. 



School Board Alignment of Policies to 
Correspond to Improvement Initiatives 

Personnel at all levels show total commitment to 
implementing Effective Schools Research and prac- 
tices. The school board, which has the ultimate au- 
thority to suggest, study, evaluate, and approve all 
matters, has provided support to the superintendent in 
his effort to ensure learning for all students. The su- 
perintendent has provided the vision, direction, and 
willingness to involve every individual in the im- 
provement process and to share with them the power 
of decision-making. Central office administrators have 
provided the necessary leadership and expertise in 
their respective areas and have aided in the analysis 
and evaluation of the results. Principals, teachers, par- 
ents, and students have brought their own unique in- 
sights to the problems at hand and have worked to- 
gether to make decisions and give support to those 
decisions. 

Another outgrowth of the Effective Schools pro- 
cess has been the adoption of a stringent attendance 
policy. The school board recognizes a direct relation- 
ship between time spent in class and learning. Thus 
the attendance policy was amended to state that a stu- 
dent may not miss more than five days of school per 
term without forfeiture of graues for the term. Princi- 



pals may exercise discretionary judgment in hardship 
cases. The policy has resulted in increased school at- 
tendance as well as in less time needed in individual 
classrooms for reteaching and retesting. 

The extracurricular activities policy is also a direct 
outgrowth of effective schooling. Since the primary 
function of the school is the education of children, 
mastery of coursework takes precedence over extra- 
curricular activities. Students must pass five courses 
each year with a minimum grade of 70 in each course 
to be eligible for participation in out-of-the-classroom 
activities. Grades are checked each semester and the 
student must maintain a 70 average to remain eligible 
for participation. 

A tuition-free, extended-time summer school pro- 
gram for students in all grades has been implemented 
for students who have not mastered the curriculum 
obj^xtives needed at the next grade level. Designed to 
provide for different rates of student learning, the 
summer program includes such subjects as English, 
math, social studies, science, and reading. High 
school students have the opportunity to earn two Car- 
negie units of credit. Elementary and junior high stu- 
dents can be promoted to the next grade level upon 
successful completion of the summer program. Stu- 
dents are grouped for instruction based on mastery of 
objectives. 

Jackson's overall retention rate at the elementary 
level is 9.9 percent (out of an enrollment of 16,000). 
After summer school that figure is reduced to 4 per- 
cent; about 60 percent pass their summer classes and 
stay with their class. Of the 60 percent, only 3.5 per- 
cent, on average, will need to attend summer sessions 
the next summer. 

At the middle and high school levels summer ses- 
sions enable additional students to remain with their 
classes. The success rate is improving. 

Personnel Evaluation System 

The personnel evaluation system for both teachers 
and administrators was rewritten during the summer 
of 1982 by a shared governance ad hoc committee 
and subsequently adopted by the school board to be- 
come school policy. The old evaluation document 
proved to be too cumbersome. The new system re- 
quires evaluation in only 16 areas and emphasizes the 
implementation of Effective School correlates and the 
district curriculum. Teachers and administrators are 
now evaluated mostly on research-based items. 

Formative evaluation of teachers occurs a mini- 
mum of twice yearly following a pre-obscrvation con- 
ference, observation, and a post-observation confer- 
ence. Summative evaluation results are discussed with 





152 



Case Studies in Effective Schools Research 



teachers each spring prior to contract renewal. Ad- 
ministrators are also evaluated formatively twice a 
year and summatively once a year by their immediate 
superiors. The school board evaluates the superinten- 
dent annually. 

Many practices and procedures initially followed to 
implement the Effective Schools process have been 
adopted as policy by the school board. A number of 
examples in personnel evaluation may serve to illus- 
trate this fact. One direct outgrowth of improving ed- 
ucation for the students was the development of a 
uniform curriculum. All teachers are expected to fol- 
low the curriculum and are monitored by their princi- 
pals. One area in which teachers are directly evalu- 
ated is implementation of the curriculum. Thus, 
failure to teach the curriculum is considered insubor- 
dination, not just disagreement with administrative 
guidelines. 

Staff development and formative evaluation proce- 
dures have been and continue to be the primary 
means of communicating to employees the district's 
commitment to the educability of all children as well 
as the means by which teachers* skills are improved. 
The major problem encountered as a result of imple- 
menting Effective Schools policies was resistance to 
change. Teachers had to be convinced not only that 
all children are capable of learning, but that they, the 
teachers, possess the skills necessary to teach them 
effectively. Teacher and student mind-sets had to be 
altered irom can't" to can." 

Resistance to change diminished with (1) increased 
involvement of teachers and administrators and (2) 
more staff development related to school improve- 
ment. Programs, procedures, and policies were devel- 
oped with input from all levels of employees, parents, 
and community supporters. 

Principals have become the primary change agents. 
Their role in the school and in the entire educational 
process has expanded greatly. They were challenged 
to change their own ways of thinking, to convince 
teachers of the value of the direction in which the dis- 
trict was moving, to involve teachers in the process, 
and to train them through staff development in addi- 
tion to monitoring and evaluating them. 

What We Would Do Differently 

At the time Jackson Public Schools began imple- 
menting Effective Schools Research, few models were 
around to follow. In retrospect, the one area that 
stands out as possibly needing a different approach 
was the development of a district curriculum which 
would ensure minimum mastery for all students and 
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provide a systematic method of assessing student 
achievement. 

When the superintendent realized that a non-op- 
tional, uniform, objective-based curriculum was es- 
sential for the improvement of education in the dis- 
trict, he moved forward with its construction as 
quickly as possible. First, all teachers were asked to 
write down what they considered to be the necessary 
units and objectives for their courses. Second, a group 
of teachers, working daily after school and into the 
early evening, began to develop the curriculum. 

It soon became evident that this procedure would 
not provide a finished curriculum quickly enough. 
Therefore, a group of the best teachers were taken 
from their classrooms for a six-week period to write 
the district's first uniform curriculum. Substitute 
teachers taught in their classrooms. Though the cur- 
riculum was largely completed during that time, the 
regular teachers had a difficult time because they 
were not only writing the new curriculum, but they 
were also overseeing lesson plans, grading assign- 
ments, and providing tests for their classrooms. 

Also, the newiy developed curriculum and grading 
system, based on mastery of objectives, would force 
the district to find a better way to keep up with stu- 
dent records. Teachers just could not manage the ad- 
ditional information they were required to keep using 
the grade book format. The district, therefore, had to 
explore available technology and determine how best 
to utilize that technology. 

To support these new programs, additional re- 
sources were needed. The district requested and re- 
ceived from the school board approval to increase 
local support through taxes. At this time the district is 
almost at the maximum level allowed for local tax 
support. 

Therefore, if the district were to begin again, the 
curriculum would still be teacher-written, but it would 
be developed over the summer months to avoid dis- 
rupting instructional processes. Furthermore, the ini- 
tial curriculum contained too much material to be 
covered in a school year. Other districts may need to 
keep in mind that the curriculum should include only 
those units and objectives deemed essential for mini- 
mum mastery and that the writing of a curriculum is 
never completed for it requires constant reexamina- 
tion and revision. 



Summary 

Figure 9 summarizes the components of the Effec- 
tive Schools movement in the Jackson district. At the 
heart of the movement have been the five correlates 
implemented simultaneously with zeal. Central to sue- 
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Figure 9. Correlates and Components of the Effective School process in 
Jackson, Mississippi 



cess of the movement has been the involvement of all 
groups who have an interest in the schools either di- 
rectly or indirectly: the school board, administration, 
teachers, parents, students, classified employees, busi- 
nessmen, and other community members. Much plan- 
ning has been and continues to be done. The curricu- 
lum has been restructured, tests have been written, 
pupil achievement has been measured, and data have 
been analyzed to determine district progress, and di- 
rections changed as needed. Both staff development 
and the personnel evaluation system have received in- 
creased attention- Communication continues to be of 
major importance as programs are implemented. 

Community support reached a major milestone in 
1986 when the Jackson Chamber of Commerce estab- 
lished an Education Foundation Trust Fund of one 
million dollars. School and community members 
raised approximately $250,CX)0 in cash and have ac- 
cepted about $400,000 in pledges to be received in 
1990. The Chamber of Commerce has set an ultimate 



goal of $2 million. Because of the trust, more money 
was available to fund projects which supplement the 
curriculum. Interested teachers submitted grant pro- 
posals to a committee which selected 20 projects for 
funding. Grant winners were selected based on (1) re- 
warding academic achievement, (2) supplementing 
and enriching the curriculun^, (3) affecting a large 
number of students, and (4) dtinonstrating measurable 
results. 

Eight years have passed since the superintendent 
first asked the question, **Can all children learn?** 
and received the answer yes. Those who answered yes 
and those whose yes came with reservations have 
come to realize that though the journey toward equity 
and excellence has been long and at times difficult, 
the results have been well worth the effort expended. 
Ask anyone in the district now, **Can all children 
learn?** The answer will be even more resounding 
than before. **Yes! All children can learn! Just look 
at ours!** 



15C 



Implementing Effective 

Schools Research in 
Spencerport New York 



Robert E. Sudlow 

Assistant Superintendent for instruction 



1S6 



Case Studies in Effective Schools Research 



Spencerport (New York) School District 

Became involved in Effective Schools process in 1982-83 



Community 

Population 

18.901 (1980 census) 

Largely suburban. Suburb of 
Rochester. Employers in high 
technobgy factories and 
industries of the Rochester area 
include: Kodak, Xerox, Bausch & 
Lomb, and Taylor. 

Almost all middle class. Six 
percent qualify for free-and- 
reduced price lunch. Median 
family income (1980 census) 
$27,135. Per capita Income 
(1980 census) $12,643. Fifteen 
percent are poor. 



School District 



Enrollm#nt 

3,322 

Ethnic Composition (p«rc«nt) 

African-American 2 
Asian-American 2 
Caucasian 96 
Hispanic 1 
Schools 



P#r Pupil Exp#nditur# 

1988-1989 



$5,577 



P#rc0nt buss«d 

95 



Ar#a (in square mIlo$) 

37.1 

Elementary schools (K-6) 3 
Middle Schools or 
Junior high schools 1 
High school (10-12) 1 



Number of Staff 

Administrators 
Certified teachers 
Support staff 

Stud0nt-Toachor Ratio 

(Classroom Teacher — 
Total staff/student ratio 
is much lower) 

Elementary 

Junior high 

High school 

P0rc«nt college-bound 

4 year college 
2 year college 
Other post-secondary 



15 
211 
249 



24:1 
23:1 
22:1 



50 
26 
17 
93 



Abstract 



This long cose study Is printed !n Its entirety be- 
cause it details extensive steps token to plan and 
then Implement the Effective Schools process in a 
suburban setting. Ronald Edmonds believed the 
Spencerport plan was on "outstanding" operational 
example of the research. The opening pages of the 
case study precisely define the phases and the pitfalls 
of the **start-up" of the Effective Schools process for 
school Improvement. A flow chart shows the pre-plan- 
ning or development phase of the program, and the 
implementation phase that hod annual cycles. 

Funding for the school Improvement program Is 
budgeted In a line Item as a symbol of commitment 
to the Effective Schools process, as c management 
tool for planning, and as a recognition and Incentive 
system for work well done. 

The actuol language from the district's master plan 
Is detailed In this case study and Integrated Into the 
narrative describing the faculty's and principals' ratio- 
nale for pkanning, goal-setting, and articulation of the 
schools' missions, me ''excellence goal" and "an- 
nual school Improvement goal" ore Tine examples of 
this explication. 



Especially useful In this cose is the detailed descrlp- 
\\on of the motivating Influence of the process of dis- 
aggregating data and reporting the analysis to all 
school personnel over the years of the project. It 
shows how this process Is applied. 

The development of curriculum and the staff de- 
velopment program ore also highlights of the 
Spencerport cose study. Although Spencerport took 
five years to complete a system-wide curriculum de- 
velopment process. It may under certain circum- 
stances be accomplished more quickly. The some 
may be the cose with preparing criterion-referenced 
tests for the dlstrfot. Spencerport developed these 
processes themselves, so therefore proceeded stowly. 

Practitk>ners like those In Spencer jDort ore the hub 
of the Effective Schools process development efforts. 
Most of the systems used by schools and districts to 
support the school improvement and Effective 
Schools process were designed by school-site person- 
nel working with central-office administrators, under 
the guidance of university and other consultants. The 
mode and colloborctk^n of Effective Schools Re- 
search consultant/trainer with district and school per- 
sonnel Is a true partnership, as well described In this 
case study. 
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Overview 

In 1982-83 the Spencerport Central School District 
decided to see if the Effective Schools Research 
could be used to help a good school system become 
better. The fact that a significant number of unrelated 
research studies discovered a common set of factors 
which were present in Effective Schools (Edmonds, 
1979) was impressive. Although this research was pri- 
marily conducted — and first implemented — in urban 
minority elementary schools, the research held prom- 
ise for helping a good school district become better. 

Spencerport's More Effective Schools/Teaching 
Project is unique because Spencerport is significantly 
different from the locale in which the early Effective 
Schools Research was conducted and in which the 
early school improvement projects based upon the Ef- 
fective Schools Research were implemented. 



Early Projects 
urban 

large minority 
population 

poor 

large districts 

project done in 
some individual 
elementary schools 



Spencerport 

suburban, and by 
some standards, rural 

5% minority 

middle class 

small district (3,322 
pupils in 1988-89) 

district-wide K-12 
project for all buildings 
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Spencerport's More Effective Schools/Teaching 
Project started to evolve during 1981 when Superin- 
tendent Joseph Clement, Jr., and Assistant Superinten- 
dent for Instruction Robert E. Sudlow studied the 
emerging Effective Schools Research. They were in- 
trigued by the fact that numerous independent re- 
search studies conducted throughout the United States 
and in England reported similar findings, something 
rare in education. Further, these findings made sense 
to the practitioners in Spencerport. They agreed with 
the conclusions that learning is a function of the 
school and that **A11 children can learn." The corre- 
lates identified by the research seemed crucial, basic, 
noncontroversial elements of a good educational pro- 
gram. If they were not present in Spencerport's 
schools, they should be. 

The Spencerport Central School District also was 
experiencing declining enrollment. Two schools had 
been closed and teachers with seven to ten years ex- 
perience in the district were being laid off. Given an 
increasingly stable staff, Spencerport needed to infuse 
systematically new ideas and new research into the 



district. Spencerport professionals believed they had 
an obligation to consider significant new research 
hitherto unavailable to the profession. They also be- 
lieved that examining this research would be an ex- 
cellent vehicle for introducing new concepts and reex- 
amining long-held beliefs. 

After considerable investigation, the assistant su- 
perintendent for instruction contacted Ronald Ed- 
monds and Lawrence Lezotte at the Institute for Re- 
search on Teaching located at Michigan State 
University. They decided to work with Spencerport 
because it was significantly different from the locales 
of the early Effective Schools projects. 

During the fall and early winter of 1982-1983 the 
superintendent and assistant superintendent met with 
each building faculty to describe and discuss the Ef- 
fective Schools Research. The videotape **Teacher 
and School Effectiveness" from the Association for 
Supervision and Curriculum Development (ASCD) 
was shown to each faculty, and later that fall to the 
board of education. At the same time the board re- 
ceived a summary of the research and a proposed 
plan of action. 

In January of 1983 Edmonds and Lezotte met with 
the board of education to describe their research. That 
evening the board approved a recommendation to 
work with the Institute of Research on Teaching to 
learn more about effective teaching, effective admin- 
istration, and effective schools. The administrative 
council, the curriculum council, and K-12 teacher 
leaders learned of the board's decision in early Febru- 
ary in a memo which set forth highlights from the re- 
search and listed events planned for designing and 
implementing the project. 

Later in February Edmonds and Lezotte held 
awareness sessions for the administrative council, the 
curriculum council, and the teachers' union executive 
committee. No administrator attended the meeting 
with the union. This was a crucial move because of 
the importance of the teachers' union in the social 
structure of the school system. 

After the awareness sessions in March of 1983 Ed- 
monds and Lezotte conducted an intensive two-day 
staff development program for the administrative 
council. And, a similar two-day program was held for 
the district -wide leadership planning team. 

The district-wide leadership planning team con- 
sisted of two key teachers from each building and 
each building principal. Other members of the team 
were the district's testing expert, a representative 
from the teachers' association, and the assistant super- 
intendent for instruction. The members of this group 
worked many hours to learn the research and to find 
ways 10 apply it to suburban Spencerport. From the 
beginning, this team exhibited considerable leadership 
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in inaugurating and conducting the project in each 
building. 

The leadership planning team was charged with the 
task of preparing a master plan for school improve- 
ment in Spencerport based upon Effective Schools 
Research. The Team was given a firm deadline for 
sending a report to the superintendent. If the team had 
not been given this deadline, it might still be talking 
about the research, not implementing it. The team de- 
veloped and unanimously approved a master plan that 
was sent to the superintendent in June 1983. The su- 
perintendent and the board approved the plan before 
the end of June (Sudlow, 1983). This planning pro- 
cess is detailed above. 

Through the awareness and planning processes, the 
More Effective Schools/Teaching Project became an 
official, major thrust of the district, (see Schedule 1) 
With the board's approval of the plan, neither the su- 
perintendent nor anyone else had the authority to ar- 
bitrarily launch the district in a different direction. 
Hence the staff is protected from a sudden change 
and from the "faddism** that too often bedevils 
school districts. 

When the plan was completed, Ronald Edmonds 
remarked that it was an * 'outstanding** operational 
statement of the research. Subsequently other school 
systems have developed master plans based upon the 
Spencerport model. This model is used by rural 
school districts (e.g.. South Lewis, New York), other 
suburban school districts (e.g.. Valley Central, Mont- 
gomery, New York), urban school districts (e.g., 
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Cohoes, New York) and schools for the deaf (e.g., 
School for the Deaf, Rochester, New York). 

One unique feature of the master plan is a state- 
ment of the basic assumptions (shown on p. 157) 
upon which the project rests. The process of writing 
and revising these assumptions significantly helped 
members of the leadership planning team to internal- 
ize the research. Ownership by the team members for 
the project increased as they debated and agreed upon 
the assumption as well as the other segments of the 
plan. 

Another unique feature of the master plan was a 
statement of functions of the building planning team 
in each school: 

Functions of Building Planning Teams 

To develop a plan for the building based upon 
the needs assessment data. This plan shall 
emphasize strengths and areas of needed 
improvement. 

To identify and agree upon the most important 
needs and subsequent objectives. 

To share this plan of action with the total 
faculty for the purposes of study, discussion, 
and change before adopting a final plan of 
action by October 1. 

To establish specific vehicles for both formal 
and informal ongoing communication with the 
faculty so that its deliberation are, and are 
perceived as, open. 

To establish regular opportunities for input and 
review throughout the school year. 

To meet periodically throughout the year to 
monitor and to facilitate the implementation of 
the plan. 

To prepare a new plan for the second and 
future years based upon the annual evaluation 
of the building plan. 

Building planning teams are small, only five to 
nine members, because in small groups everyone is 
likely to be an active participant- The members are 
the key leadership group of the school, not the grade- 
level chairpcople or the department chairpersons. The 
teams consist of the principal and teachers respected 
by their colleagues who are broadly representative of 
the faculty. (The princin?, personally must attend 
every meeting, on time, and leave at the end, because 
teachers often key on the behavior, not the words, of 
the principal.) 

For the first year of the project, teacher members 
of the district-wide leadership planning team were ex- 
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Spencerport's Fifteen Assumptions About 
More Effective Schools/Teaching i^roJecf$ 

1 Virtually all students are educable when educabiiity is defined as pupil acquisition of basic 
school skills. 

2. Research concludes that school effects are more pdwerful than femllial effetetisL this conclu- 
sion must not be taken to mean there Is no familial effect In pupil acquisition of academic 
skills. In some families, background does not limit a student's ability to acquire basic school 
skills, but some families can enhance student achieviament well t)eyond basic school skills. 

3. The annual goal of education is to bring each student to at least the standard minimum 
academic performance for that grade level so that he or she can perform successfully In the 
next grade level. Further, the goal of education is to prepare students so that they can make 
as many choices as possible. Thus, upon graduation from high school all students should be 
able, as a result of their education, to choose whether oi' riot to enter college, or to attend 
another form of post-high school education, or to obtain a job. 

4* Tliere is a positive correlation between academic student achievement and staff expecta- 
tions. 

5. An emphasis upon learning, upon academic achievement, is the prime purpose of public ed- 
ucation. 

6. Teachers and principals can and do make a key difference in the quality of education each 
child receives. . 

7. A school building is a complex social system with a set of norms, beliefs, and patterns of 
behavior which can facilitate or hinder learning. 

8. Collaborative, cooperative, collegtal, supportive, non-coercive planning, especially at the 
building level and accompanied by support from district office personnel is the key approach 
to improvement. 

9. The building principal has a key role in establishing the climate of his or her building. 
10» Change is a process, a series of related events, not one event. 

11. Ideal change fosters ownership and commitment by all participants. 

12. In many ways, the schools In this district are effective. The challenge Is to make them more 
effective. 

13. This project affects all school personnel. 

14. Because the climate of a school Is dependent upon all of its occupants, the indi\ddual school 
buildting as a whole is the ^rategic linlt for planned change. To obtain change, attention 
must l)e paid to the culture of the schools; focusing on the behavior of individual teachers or 
students is not sufficient. 

15. Focusing on Effective Schools Research may necessitate realignment of other priorities 
within the building. 
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pected to be on their building's planning team. They 
were expected to link the work of the district team to 
the newly formed building team. Other teachers were 
selected, depending upon the culture of the building, 
by election, by volunteering, or by selection. When 
teachers left teams, other teachers replaced them. 
Some teachers rejoined their teams after being absent 
for a year or two. 

As the district-wide leadership planning team ap- 
proached completing its work, it began to plan for op- 
erational implementation in each building. This 
staned with a superintendent's conference day held 
on May 20, 1983 for all teachers and administrators. 
Ronald Edmonds provided a brief overview of the re- 
search. Teachers then completed the needs assessment 
instrument which the leadership planning team had 
selected,^ and professors from Michigan State Univer- 
sity described various aspects of effective teaching re- 
search. 

Each building then selected teachers to be on its 
building planning team. At approximately the same 
time achievement tests, mandated New York State 
tests, and final exams were given. Because the school 
system had no socioeconomic status (SES) informa- 
tion for each child, the mother's level of education 
(Frederiksen and Edmonds, 1977) was obtained 
through the annual census mailed to each resident of 
the district. Research revealed that responses to the 
census card request were representative of the com- 
munity (Sudlow, 1983a). The district proceeded with 
confidence to conduct the first disaggregated analysis 
of test data. During the summer of 1983 Edmonds 
and Lezotte analyzed the Connecticut School Effec- 
tiveness Questionnaire needs assessment data and pre- 
pared written profiles for each building.^ 

This completed the turnkey phase of implementing 
the project: 

Turnkey Phase of the Project 

May-June 1983 Formation of building 
planning teams 

May-June 1983 Initial needs assessment: 
disaggregated analysis 
presence of correlates 



1. The leadership team examined four needs assessment instruments 
which measured the presence of the correlates and selected the Con- 
Dccticut School Interview. Because secondary versions of this in- 
strument did not exist, Edmonds and Lezone helped the team to 
modify the elementary instrument so that it is appropriate for the 
junior and senior high school levels. 

Z The profile for the Cosgrove Junior High School wae the 
last paper Edmonds wrote before his untimely death on July 
^ 15, 1963. 
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Early summer 1983 Preparation of school 
profiles 

Late summer 1983 Data analysis of build- 
ing planning teams 

Due by September 1 Preparation of draft 

plan by building plan- 
ning teams 

As mentioned above, when the project began Ed- 
monds and Lezotte analyzed the data from the Con- 
necticut Questionnaire and prepared a written profile 
of each school. The building planning teams used this 
document to prepare their draft plans of action for the 
1983-84 school year. Additional staff development 
was needed to review the data and develop a plan. 
During the summer of 1984 Dr. Patrick Proctor from 
the Connecticut State Department of Education^ 
trained each team regarding the processes to follow 
when analyzing needs assessment data and writing a 
plan. This was a most helpful workshop which many 
still regard as a highlight of the project. 

The right side of Figure 1 presents the annual im- 
plementation cycle of building planning teams. The 
faithful implementation of these steps is the heartbeat 
of an Effective Schools project. Lawrence Lezotte 
once observed that **the good news about school im- 
provement is that you can start it any time. The bad 
news is that once you start, you can't stop!" Figure 1 
illustrates this statement. 

One step in the annual implementation cycle is re- 
view and approval of building plans by the superin- 
tendent. If superintendents do exercise the option of 
disapproving a plan, they should disapprove building 
plans only if building planning teams commit one of 
the two types of errors teams may make in their ini- 
tial years. One error is that the action plan is not re- 
lated to the needs assessment data. For example, sup- 
pose that the needs assessment data reveal a major 
problem in arithmetic and the team proposes to install 
a content area reading program. Although content 
area reading is an excellent, valid program, it will not 
solve a major arithmetic problem. The second error 
occurs when the team proposes an action plan which 
**puts the monkey on someone else's back." For ex- 
ample, the school will become effective when the dis- 
trict forms a committee to study student retention pol- 
icies. 

A building planning team should not * 'place the 
monkey on someone else's back." How a staff 
chooses to use its time, money, and human and mate- 
rial resources will determine if a building becomes ef- 
fective. This is because in the original research, Ef- 



3. Dr. Proctor currently is assistant superintendent for instruction, 
Windham Public Schools, Willimantic, Connecticut. 
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EFFECTIVE SCHOOLS PROJECT FLOWCHART 



Development 



Implementation/Annual Cycle 



1/2 day 

SEPT-DEC 
2 hours/ 
group 

JAN-FEB 
2 days 

MARCH 
2 days 

APRIL 



SPRING 



APRIL 



MAY- JUNE 



SUMMER 
4-5 days 



Pre-Planning 



Awareness 
'Building F8v:ulties 
'Key Leadership Groups 



Inservice 
-Leadership Planning Team 



Development of Master Plan 



App ~"al by: 
'Super intendent 
'Board of Education 



Awareness 
-Total K'12 Faculty 



Formation of Building Planning 
Teacns 



Initial Needs Assessment 
-Disaggregated Analysis 
-Presence of Correlates 



Training of Building Planning 
Teams 

-Group Process Skills 
-How to Analyze Data 
-How to Develop a Plan 



Data Analysis 
by Building Planning Teams 



SUMMER 
4-5 days 



SEPTEMBER 



OCTOBER 



OCTOBER- 
JUNE 



MAY -JUNE 



Preparation of Draft Plan 
by Building Planning Teams 



Review and Endorsement by 
Faculty 



Review and Approval by 
Super intendent 



Implementation by 
Faculty 



Evaluation 
-Disaggregated Analysis 
-Presence of Correlates 



Staff Development 
Action Research 
Professional Reading 



Continued Support 

and Encouragement f rom 

District Off ice 



Figure 1. Effective Schools Project Flowchart 



ERIC 



163 



162 



Case Studies in Effective Schools Research 



fectivc Schools were found where learning was occur- 
ring and was independent of the students' socioeco- 
nomic class. Three blocks down the street, in the 
same neighborhood, ineffective schools were found. 
Because the types of children attending both schools 
were the same and because issues as per-pupil budget 
allocations and class size are district-wide, one con- 
cludes that although both buildings had the same 
types of resources, the same **inputs,*' the adults in 
building A organized and used their resources differ- 
ently than did the adults in building B. Hence what a 
staff does with its resources determines if a building 
is, or will h>e, effective. 

During the first two years of Spencerport's project 
several buildings made one of these types of error. 
When the superintendent rejected part of a plan or 
raised serious questions about it, there was initial re- 
sistance from some building planning team members. 
Fortunately, other members observed that issues were 
raised which the team had not considered. Thus, a 
superintendent's review of a building plan can help a 
building from inadvertently committing basic errors. 

The overall process described above is the essence 
of a school improvement project based on Effective 
. Schools Research. In summary it consists of: 

• Creating extensive awareness. 

• Having a representative group of teachers and ad- 
ministrators write a master plan for the district that 
is approved by the superintendent and board of ed- 
ucation 

• Administering a needs assessment instrument 
which measures the presence of the correlates 

• Disaggregating student achievement data 

• Having a building planning team that represents 
the faculty and administration. The team annually 
develops a proposed school improvement plan 
based upon the needs assessment data and works 
with colleagues to implement it 

• Having faculty review and approve the proposed 
plan 

• Evaluating the effects of the building's plan by re- 
administering the needs assessment instrument and 
by disaggregating spring testing data 

• Preparing a new or continuing plan of school im- 
provement based upon the spring evaluation data 

If a school system includes all of the above in its 
project, then it is doing a school improvement project 
based upon the Effective Schools Research. If any 
one of the above is absent, then the school is con- 
ducting a generic school improvement project. These 
two types of projects are related, but different 
(Sudlow, 1984a). See Figure 1 for a flowchart of the 
overall process. 

EIUC 



Needed Resources: Funding and Time 

Spencerport is not a high wealth **silk stocking'' 
district. Out of the 18 school districts in Monroe 
County, Spencerport ranked 14th in wealth per pupil 
and is 16th in expenditures per pupil. Spencerport is 
25 percent below the state average in both wealth and 
expenditures per pupil, (see Table 1) 

All of the funds to support the improvement pro- 
cess came out of the local budget. On the average 
Spencerport spent $20,000 to $25,000 to initiate and 
support the project. Funds are used for consultant ser- 
vices, clerical costs (part-time clerks to record data 
and data analysis at peak periods cost $5,000 to 
$6,000 annually), supplies, and travel. Nationally the 
L iian budget for Effective Schools projects is 
$5,000 per building (Miles, Farrar & Neufeld, 1983). 
Spencerport recommends this as a guideline for plan- 
ning an annual budget for an Effective Schools proj- 
ect, (see Table 1) 

Time is a symbol of importance and of support. If 
teachers and administrators are asked to do a project 
in addition to a full work load, that sends one mes- 
sage. If arrangements are made for the project to be a 
part of the regular work day, another message is sent. 

During the developmental phase of the project, re- 
leased time was provided for the awareness sessions 
with the curriculum council and the administrative 
council, and there were other incentives. The evening 
awareness session for the Teacher's Union Executive 
Committee occurred in a local restaurant with an ex- 
cellent dinner paid for by the district. The extensive 
staff development sessions of the administrative coun- 
cil and the district-wide leadership planning team ran 
from 9:00 A.M. to 3:00 P.M. Released time was pro- 
vided for the leadership planning teams to write, edit, 
and approve the master plan. 

The building planning teams worked long and 
hard. Rather than espousing only one model to meet 
their time needs (for example, released time one after- 
noon a month), time was provided in a manner appro- 
priate to the task. For example, full days and half 
days of released time were provided for specific pro- 
jects. The school district rented meeting rooms and 
purchased excellent dinners in good hotels for late af- 
ternoon and evening meetings. For the first lime in its 
history, the district authorized summer curriculum 
monies to support the work of building planning 
teams (both as groups and as individuals working on 
projects) during school vacations. Four half days of 
time were provided each sunrncr for a building plan- 
ning team to analyze the needs assessment data and 
write a draft plan. If the teams request additional 
days, they are provided. In addition, building planning 
teams met frequently throughout the year either just 

-.16-;-.- 
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Table 1 

PER PUPIL • OPI^RATING 


. : Mofiroe-:' • ■ ■■ ■ • : ■ Speh. "% 
Stite 'Cpu Spencerpdit Below County 
Year Average Averiaiiije" " ; Actual ; : Average 


Spencerport 
Rank in 
County 


1982-63 : N. A: $ 3;24i^ $ 2,684 17.2 
1986-87 N,A. 4.420 3,846 129 


16/18 
16/18 


A district adopting the Spencdrpoit model in 1988 could at a minimum expect to incur the 
following costs during the devieloprtf^eht phase of a project 


Planning— 1 consultant day @ $500 


$ 500 


Awareness— 0 to 2 consultant days @ $500 


500 


Training of district leadership tieam— 4 consfultant days @ $500 


2,000 


Training of building planning teams— 4 to 5 days @ $500 


2,000 


Consultant travel expenses 


Variable 


Sending 5 or 6 key staff members to regional or national Effective Schools 
awareness corifeirences^^^® 


3,000 


Sehdihgi 10 to 2Q teacihers and prihcipals to visit where the replicating district is located. Variable 


Additional part-time de^^ 
oisaggregate tesj^^^^^^ 
process ne^ asses^^^ data 
help prepi^e annua! evai^ 


5,000 


Fteleased time during the school year for training of district leadership team, 
<^s depeiKl tijpori locar su 


Variable 


Summer currtcuiumi pay for the building planning team for training and for 
developing a pian: Costs depend upon local contract. 


Variable 


Supplies 


5,000 


Costs of Implementing building plans. This can be done by any one or a 
combination of the following: 

reallocating current summer curriculum funds 

realtocaSng current s^ funds 

reallocating current teacher conference funds 

(providing an allocation of $2,d00-:$4,000 to the buildings) 


2,000^,000 


ESTIMATEDTO 


$20.000--22,000 
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before or just after school. Thus, time to operate the 
project came partly from the district and partly from 
the teachers. 

Symbolic support and regular communication 
about the project has been and continues to be impor- 
tant. Annually the superintendent meets with each 
building planning team to ask: How are things going? 
What are you doing? What can I do to help you? Sev- 
eral times the board of education financed **thank 
you'* receptions and dinners in local hotels. Twice 
the district sponsored state-wide conferences about 
the project and featured the work of building planning 
teams. It is rare for teachers to have the opportunity 
at state-wide conferences to describe what they do, 
their accomplishments, and their problems. Teachers 
who were involved in these conferences said that 
their participation was motivating and provided a 
feeling of accomplishment. 



Evidence That the Schools Are Improving 



Student Achievement 

Because the Spcncerport district-wide leadership 
planning team believed that the schools would not im- 
mediately achieve the project goal, the team wrote an 
annual school improvement goal. 

Should a school building not be effective according lo the 
project's goal, then the following criteria for school im- 
provement will be used until a building becomes effective: 

(1) There shall be an annual increase in the proportion of 
students who demonstrate minimum academic mastery, and 

(2) There shall be an annual decrease in the proportion of 
youth demonstrating minimum academic mastery as a func- 
tion of socioeconomic class. 

While the disirict-wide leadership planning team 
was meeting and deliberating, Edmonds and Lezotte 
observed that in the early Effective Schools projects 
the achievement of all the children rose even though 
they concentrated primarily on the children just at or 
below minimum academic mastery (Edmonds and 
Lezotte, 1983). After considering the implications of 
this statement the team decided to write a concomi- 
tant goal addressing the achievement of children v^ho 
normally receive excellent scores. Thus through the 
concomitant goal, the team made this a project for all 
students. The district could not be accused of improv- 
ing the learning of students who normally fail at the 
expense of students who normally do well. 

The concomitant goal, now called the **excellence 
goal,'' states: 

The number of students with outstanding achieve- 
ment will rise: 



1. There shall be an annual evaluation of the per- 
centage of students scoring in stanines seven, 
eight, and nine on the Stanford Achievement 
Test in Reading Comprehension and Total 
Mathematics or of the percentage of students 
scoring at or above 90 percent on a Regents ex- 
amination.^ 

2. For those subjects in which a significant propor- 
tion of the students take a Regents exam, (1) 
There will be an annual increase in the percent- 
age of students scoring 65 percent or higher, 
and (2) There will be an annual increase in the 
percentage of students taking the exam. 

Many school districts which traditionally have 
good or excellent achievement doubt that an Effective 
Schools project will help them. The **excellence 
goal" certainly would challenge them. By all tradi- 
tional criteria Spencerport was a good, respected 
school system. Spencerport wanted to use the Effec- 
tive Schools Research to help a good school system 
become better. The * 'excellence goal'* is an important 
part of the effort. 

Spencerport did not want the starting of the Effec- 
tive Schools project to give the impression to constit- 
uents (teachers, administrators, students, board of edu- 
cation, community) that the school system was 
ineffective, a reason many districts may not embark 
upon an Effective Schools project. This problem was 
solved by placing the word More in the project title: 
**More Effective Schools/Teaching Project.** 

Evaluation data for the project are presented annu- 
ally in open session to the board of education. The 
first annual report on school improvement was pre- 
sented in October 1984 (Sudlow, 1984b). For each 
building the report presents data using disaggregated 
analyses of student achievement that show how stu- 
dents are improving and the degree to which the cor- 
relates of an Effective School are present. A summary 
of the report is distributed to all employees, both pro- 
fessional and support staff. Each princ lal and each 
member of a building planning team receives all the 
data for his or her building. 

The annual evaluation report is significant because 
it causes teachers and administrators to realize that 
the district is serious about the project. Further, it 
provides the board of education with evidence that 
the project is improving both the quantity and quality 
of student learning and that the climate of the schools 
is improving. As a result, board support for the proj- 
ect has continued. (See Table 2 for definitions.) 



4. New York Regents Examinations are criterion •referenced tests 
developed annually by the State Education Department. They gener- 
ally are considered appropriate for the average and above-average 
student, the college-bound student. 
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Table 2 

Evidence of School improvement 

Evidence that the schools are improving as a result of the project needs to be 
measured against the project's goals. The master plan sets forth the following goats 
for each building in the district: 

1, Ninety-five percent or greater of ail the students at each grade level should 
demonstrate minimum academic masteryr. Students who achieve minimum 
academic mastery have been prepared so that they will be predictably success- 
ful in the next grade in either their own school district or in any other school 
district throughout the nation. Minimum academic mastery ts measured by per- 
formance on a standardized achievement test (preferably criterion-referenced, 
otherwise norm-referenced)« 

2. There shall be no significant difference in the proportion of youth failing to 
demonstrate minimum academic mastery a3 a function of socioeconomic class. 

a The above two conditio, js shall have been obtained for a minimum of three 
consecutive years. 



Tills goal can be illustrated as follows: 



Low Middle and Upper 

Socioecofiomic Classes Socioeconomic Classes 

At or above minimum academic 

"mastery ^ 95% ^ ggo^ 

Below minimum academic mastery s 5% i 5% 



Two phrases, "minimum academic mastery" and "socioeconomic class," need to be 
defined to understand the project's goals. There are: 

1 Minimum Academic Mastery. Students who achieve this standard will be pre- 
dictably successful in the next grade either in this or in any other school district 
throughout the nation. Minimum academic mastery shall be measured by per- 
formance on a standardized achievement (norm- or criterion-referenced) test. 
The cutoff point between minimum and unsuccessful academic mastery shall 
be established in advanca 

2, Socioeconomic class is determined by the number of years of fooDal education 
of the student's mother. If the level of the mother's formal education is not avail- 
able, then the level of the father^s formal education will be used. Should a child 
not be living with his or her parents, then the number of years of formal edu- 
cation of the surrogate female parent shall be used. 



These definitions were made available to the field (Sudlow 1984a, 1985). and are 
used in at least two states. South Carolina (School Effectiveness, 1985) and New 
York {New York State School Improvement Program Guidebook, 1987). 
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Bemabi School: Disaggregated Analysis of Arithmetic 
Percent above the 40lh percentile 




1983 



1984 



1985 



1986 



1987 



1988 



00 



Middle & Upper SES O Lower SES ♦ Project Goal 



Figure 2. Bernabi School: Disaggregated Analysis of Arithmetic 



Project Goal 

When the Spencerport disaggregated analyses of 
student achievement were studied, two categories of 
effectiveness emerged based on Regents exams and 
the Stanford Achievement Test. They are: 

1. Effectiveness — 95 percent or greater of both the 
lower SES group and the middle and upper SES 
groups attain minimum academic mastery. 

2- Near Effectiveness — ^90 percent or greater of 
both the lower SES group and the middle and 
upper SES groups attain minimum academic 
mastery. 

The June 1988 data, for example, show the levels 
of achievement for Spcncerport*s schools and for how 
many years and are displayed in Table 3. 

In Figure 2 the disaggregated analysis for Bernabi 
School arithmetic is presented. The project goal was 
that 95 percent of all students, regardless of socioeco- 
nomic status shall achieve minimum academic mas- 
tery. This is represented by the straight line. The pro- 
portion of middle and upper SES students who attain 
minimum academic mastery is represented by a solid 
circle. The data for the lower SES students is repre- 
sented by an open circle. 

There are many ways to measure achievement. 
Spencerport identified minimal academic mastery as 
scoring at or above the 40th percentile on the Stan- 
ford Achievement Test. The Stanford Achievement 
Test was selected on the basis of a three-year study to 



ascertain which achievement test best measured dis- 
trict curriculum. Of all the major norm -referenced 
tests, the Stanford to a substantial degree measures 
Spencerport*s intended curriculum (Ferris, 1982). 

Figure 2 represents the ideal, what should be. The 
trend lines for both SES groups are upward and the 
achievement gap between the two groups is steadily 
decreasing. Ninety-five percent, or greater, of both 
groups have scored at or above minimum academic 
mastery for the three most recent consecutive years, 
illustrating the classical definition of effectiveness. 

A graph typical of an improving school (here 
Munn school was selected) appears below in Figure 
3. In this figure there is an upward trend line for both 
the lower and the middle and upper SES groups. The 
achievement gap between the two groups has varied, 
but appears to be decreasing. 



School Improvement Goal 

The school improvement goal (interim project 
goal) which appears earlier calls, in part, for an an- 
nual increase in the proportion of students scoring 
above minimum academic mastery until 95 percent of 
all students (including the mildly handicapped, the 
learning disabled) score at or above minimum aca- 
demic mastery. The effect of this goal upon student 
achievement in reading and mathematics is shown in 
the following tables. 
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Table $ 

Effectiveness and Near Effectiveness Student Achievement by School 
For Reading Achievement at various schools 

1. Near Effectiveness ' Bemabi (Grades 1-6), Stanford Achievement Test, 4 years 
Z Effective Wilscm (Grades 10-12), Regents Competency Test, 5 years 



For Mathematics Achievement 



1. Near Effectiveness BcmaKi (Grades 1-6), Stanford Achievement Test, 2 years 

Munn (Grades 1-6), Stanford Achievement Test, 1 year 
Town Line (Grades 1-6), Stanford Achievement Test, 1 year 
Cosgrove (Grades 7-^), Stanford Achievement Test, 7th and 8th Math, 1 year 
Cosgrove, Math Regents Competency Test, 2 years 
Cosgrove, Math Regents Exam, 1 year 



2. Effective Beniabi, Stanford Achievement Test, 3 years 

Cosgrove, Math Regents Exam, 2 years 



For Science Achievement 



1. Near Effectiveness Cosgrove, Earth Science Regents Exam, 3 years 

Wilson, Science Regents Exams, 2 years 



2. Effective Wilson, Science Regents Exam, 1 year 



For Social Studies Achievement 



L Near Effectiveness Wilson, Regents Exam, 4 years 



For English Achievement 



1, Near Effectiveness Wilson, Regents Exam, 2 years 

2. Effective WilscHi, Regents Exam, 2 years 



For Writing Achievement 



1. Effective Cosgrove. Regents Competency Test, 2 years 

Wilson, Regents Competency Test, 5 years 

Detailed data to support the above appear in the Fifth Annual Report (Sudlow, 1988a). 
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Table 4 

Reading comprehension: Percent of students at or above the 40th 
percentile on the Stanford Achievement Test 



School 


82-83* 


83-84 


84-«5 


85-85 


88-87 


87-88 


Bernabi (Grades 1-6) 


87 


90 


91 


92 


93 


95 


Munn (Grades 1-6) 


74 


80 


78 


83 


81 


90 


Town Line (Grades 1-6) 


77 


80 


83 


85 


87 


87 


Cosgrove (Grades 7-8) 


72 


76 


78 


80 


80 


83 



*Base fine year 



The tables show that Spcncerport started with high 
proportions of the student body above minimum aca- 
demic mastery and that these proportions improved, 
thus further substantiating the claim that the school 
improvement goal is being met. 

Concomitant-Excellence Goal 

By one stroke this gotil made our project advanta- 
geous for all students because it connected the 
achievement of students who normally do well with 
those at risk. Briefly, it says that the proportion of 
students who attain scores indicative of excellence 
(i.e., stanincs 7-8-9 or a grade of 90 percent or better 
on a Regents exam) will either remain the same or 



increase. It also calls for an annual increase in the 
proportion of students passing and taking Regents ex- 
aminations. This standard is demonstrated also in the 
results of student scores on the Stanford Achievement 
Test. (See Tables 4, 5, 6) 

Table 6 shows that Spcncerport started with high 
proportions of the student body scoring in the top 
three stanines. Nevertheless, the proportion increases 
in ten of twelve instances. An analysis such as this, 
that is of the proportion of students who obtain excel- 
lent scores, is not one which school systems normally 
develop. When the school district prepared this analy- 
sis, both teachers and administrators were happily sur- 
prised at the number of students who did wclL This 
motivated them to improve their efforts. 
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Total Math: Percent of students at or above the 40th percentile . 






on the Stanford Achievement Test 






School 


82-83* 


83-84 


^4-85 




86-87 


87— 88 


Bemabi (Grades 1-6) 


89 


91 


93 


97 


96 


96 


Munn (Grades 1-6) 


86 


84 


88 


90 


89 


93 


Town Line (Grades 1-6) 


83 


88 


87 


88 


89 


92 


Cosgrove (Grades 7-8) 


81 


85 


86 


86 


92 


92 



Tables 

Percent of Students Scoring in Sianines 7-9 on the Stanford Achievement Test 



82-83* 83-84 84-85 85-86 86-87 87-88 



Reading Compretien$ion 

School 



Bernabi (Grades 1-6) 


47 


47 


49 


47 


49 


56 


Munn (Grades 1-6) 


30 


32 


34 


40 


40 


45 


Town Line (Grades 1-6^ 


41 


44 


46 


45 


48 


51 


Cosgrove (Grades 7-8) 


34 


27 


32 


34 


35 


34 








Total Mathematics 






School 














Bernabi (Grades 1-6) 


55 


57 


62 


68 


74 


72 


Munn (Grades 1-6) 


50 


47 


53 


56 


53 


59 


Town Une (Grades 1-6) 


49 


50 


51 


55 


62 


60 


Cosgrove (Grades 7-8) 


34 


45 


49 


45 


52 


60 


Subject 














Language (Grades 7-8) 


31 


35 


35 


39 


40 


34 


Listening (Grades 7-8) 


29 


27 


26 


28 


32 


31 


Science (Grade 8) 


37 


26 


28 


24 


31 


30 


Soc. Studies (Grade 8) 


33 


37 


38 


33 


37 


41 



*8aM lin« yMr 

f=6r • frame of r«(tr«nce wHh which to Interpret th« •bove, n«tior«)ly 23 percent of the students score in stanines 7-9 of 
Ihft Stanford Achievvment Test. 
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REGENTS EXAM in English 
Grades 9-12 
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Figure 4. Regents Exam in English, Grades 9-12 

The impact of the excellence goal upon the 9-12 
instructional program can be seen in the graph in Fig- 
ure 4, data on Regents Exam achievement in English, 

In this graph Spencerport data for the percent pass- 
ing and taking are represented by the filled symbols 
and New York State data are represented by the open 
symbols. The proportion of Spencerport students tak- 
ing the comprehensive (i.e. it measures grades 9-11) 
eleventh grade Regents exam in English increased 
from 53 percent in 1983 to 86 percent in 1988. At the 
same time the percent passing dropped from the 95 
percent range to 92 percent — which is equal to or bet- 
ter than the state average percent passing when only 
slightly over half of the students throughout the state 
take the exam. Further the proportion of students at- 
taining excellent scores of 90 percent or higher in- 
creased from 7 percent in 1983 to 9 percent in 1988. 

**This is proof that all kids can learn," one admin- 
istrator commented while discussing the graph. Such 
a dramatic increase in the percent of students taking 
the course, being successful in it and successfully 
p^^ssi^g the state exam, could only occur as a result of 
teachers who, in private and in their classroom, have 
high expectations for success and then take action. It 
could not have occurred as a result of administrative 
intervention. In the past, administrative efforts to re- 
solve problems with various Regents exams resulted 
in more students being successful, but these efforts 
did not increase the proportion of the student body 
taking the academically more challenging Regents 
level courses and passing the accompanying examina- 
tions. 



Other Student Data 

Ron Edmonds observed that a key gatekeeper 
course in most high schools is algebra. If a student 



takes it, then he or she is much more likely upon 
graduation to be able to choose whether or not to go 
on to further education or to enter the world of work. 
If, on the other hand, a student takes general math in- 
stead of algebra, his or her possibilities of being able 
to choose to go on to further education are greatly di- 
minished. Hence a school should structure its instruc- 
tional program so that all students should be able to 
take algebra and be successful in it (Edmonds, 1983). 

As the Spencerport math teachers thought about 
this, they decided in the spring of 1987 that if they 
had the general math students for a little more time 
they could teach them algebra. The added lime was 
found by using study hall periods opposite a Monday, 
Wednesday, and alternative Friday gym class. Instead 
of sitting in study halls, students gained ground in 
math by having it 7 1/2 periods a week. The impact 
of this upon the proportion of students taking Regents 
algebra appears in Figure 5. 

Instruction was modified so that one half of the ad- 
ditional time was spent on the content and one half 
was spent on the affective domain — because these tra- 
ditionally were the students who had been least suc- 
cessful in math and probably did not like it. 

Many of these students were successful. End-of- 
the-year results on the Regents exam were: 

A— 7% B— 22% C— 26% D^19% F— 26% 

Four of the seven students who failed the Regents 
did so by only one to four points. These results are 
outstanding for students who previously were consid- 
ered not capable of taking and passing the Regents al- 
gebra course. A related program with similar results 
also occurred in the ninth grade Regents earth science 
course (Sudlow and Wcrth, 1988). 

As teachers' and administrators' expectations of 
what students could do increased, so too did their 
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REGENTS EXAM ALGEBRA 
9lh Grade 




86-87 



87-88 



-0- Spencerpon 
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Figure 5. Regents Exam in Algebra, 9th Grade 



level of aspiration. This resulted in far more students 
earning the academically demanding Regents diploma 
than ever before (Figure 6). When reading this graph, 
it is useful to know that in school districts serving the 
highest socioeconomic areas of the county, 65 to 70 
percent of the students receive a Regents diploma. 



Presence of the Correlates 
of Effective Schools 

To ascertain the extent to which correlates of an 
Effective School are present in a building, a needs as- 
sessment survey based upon the Effective Schools Re- 
search was taken. The building planning team, com- 
posed of the principals plus a small group of 
respected, representative teachers, analyzed the data 
from the needs assessment instrument to determine 
priorities and to develop a proposed plan of action. 
This plan of action was presented to the faculty for 
approval. 

The Connecticut School Effectiveness Question- 
naire, an instrument developed by the Connecticut 
State Department of Education, was selected because 
it specifically ascertains the presence of the correlates 
of an Effective School. Validity was established 
through a review of the literature and a content vali- 
dation study. Construct validity was established 
through multitrait-multimethod analysis (Villanova, 
1984; Proctor and Villanova, 1984). 

Because the interview was prepared solely for ele- 
mentary schools, Spencerport modified it, under the 
direction of Edmonds and Lezotte, to be appropriate 
also at the junior and senior high school levels. 

When Spencerport started its project, for all practi- 
cal purposes the correlates used to describe Effective 
Schools were absent. The district is making substan- 



tial progress in manifesting the correlates of an Effec- 
tive School, This is summarized in Table 7. 



Personnel Data 

If the data show that both the equity and quality of 
student achievement have improved, then what is the 
reaction, the opinion of the principals and teachers 
who daily work to implement building plans? During 
late 1987 and early 198^ an outside researcher inter- 
viewed each principal and representative members of 
each building planning team. Interviews were confi- 
dential. The interviewer reported: 

As the interviewees talked about the project, many topics 
were mentioned by more than one person. For example, the 
project was credited with improving communication. They 
mentioned more communicaMon between teachers, teachers 
and principals, and between staff in the schools and the cen- 
tral office. Several mentioned the project's healing effect on 
wounds from a strike in the mid-nineteen-scventics. 

The project was also credited with encouraging col- 
laboration. The feeling seemed to be that they were all to- 
gether now and working on the same goals. Central office 
seemed to have demonstrated its long-term commitment to 
the project by providing the necessary resources and by al- 
lowing building autonomy within the district guidelines. 
Principals accepted criticism of their instructional leadership 
and had delegated some decisions to the building commit- 
tees. Teachers expressed ownership in the project and satis- 
faction in being involved in the decision-making processes 
of the district. Some felt more professional because of the 
project activities. 

Adult learning was mentioned frequently as a byproduct 
of the project. Two district staff development programs, ** El- 
ements of Instruction" and '*TESA** (Teacher Expectations 
for Student Achievement) were named specifically, but also 
interviewees mentioned informal staff development through 
project activities. This learning was recognized as a neces- 
sary means to the desired end, Effective School with ef- 
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Table 7 












Number of correlates in place in each schoor^ 






School: 


Bernabi 


Munn 


Town Line 


Cosgrove 


Wilson 


Total 


Possible<^^ 




(K-6) 


(K-6) 


(K--6) 


<7-«) 


(10-12) 






May 1983* 


1 




2 






3 


35 


May 1984 


5 


2 


3 






10 


35 


May 1985 


5 


3 


5 


2 


3 


18 


35 


May 1986 


7 


5 


5 


2 


5 


24 


35 


May 1987 


7 


5 


7 


7 


4 


30 


35 


May 1988 


7 


7 


7 


7 


6 


34 


35 


*Bas« line y«ar 
















(a) A correlate is considered to be present when two-thirds of the faculty indicate on a needs assessment instrument that 


the Characteristics which comprise the conflate are present tn the building. 








ib) Seven orrelates per building times five buildings. 











fcctivc icachcrs. The adjectives fun, stimulating, and enjoy- 
able were assodated with project involvement. However, 
stress and accountability were also discussed. One inter- 
viewee was planning to retire early and another was plan- 
ning to work longer, due to the project (Wooley, 1987). 

During the spring of 1988 a frcc-lancc writer also 
interviewed a large number of teachers and adminis- 
trators to write a scries of eight articles about the 
project. During the interviews she noticed several un- 
derlying themes regarding the project's impact. Her 
observations noted many patterns as follows: 

When I began interviewing teachers for a scries of Public 
Information articles on the More Effective School s/Teaching 

erk: 



Project in Spcnccrport, I at first regarded similarities of atti- 
tudes and responses as a vague coincidence. As I talked with 
a larger random sample of teachers from all five building in 
the district, it became obvious to me that what I was hearing 
clearly reflected the impact of the project at all levels, in 
many different areas. 

No matter which correlate we were discussing, teachers 
used different words to describe similar feelings. The most 
overwhelming sentiment was that the project BRFHDS COL- 
LnCiIAIJTY, 

**It's like we all care about the same thing.'' 

**It gave us a reason to sit down and talk about what we 
all care most about — doing our best with kids." 

*Mt gives us a process for problem -solving that involves 
ownership and agreement." 
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Over and over again, teachers spoke favorably about how 
the committee work, the needs assessment, the focus on test- 
ing and curriculum, had forced them into a type of COM- 
MUNICATION with their colleagues which they found both 
satisfying and stimulating. 

Many referred to the fact that the way the project is organ- 
ized to include EVERYONE in the district from the adminis- 
tration to the custodians, fostered a sense .of real participa- 
tion and OWNERSHIP. They felt their opinions mattered. 

Several people I spoke with, most notably one principal, 
reflected on how many aspects of the project (e.g., ELE- 
MENTS OF INSTRUCTION AND TESA) and rc-kindlcd 
the kind of excitement and enthusiasm he had felt as a 
young teacher and had long since lost. And a general refer- 
ence to a renewed feeling of PROFESSIONALISM was 
often repeated. 

**The project has given teachers the opportunity to teach 
and the students the opportunity to learn." 

"It has made it so we have a good feeling about coming 
to that door every morning." 

"We just want to be able to teach what the kids need to 
know, share with out colleagues, and have a little fun along 
the way. Now we are doing that." 

Part of their honesty revealed skepticism, past and present. 
Some teachers admitted that not every member of their fac- 
ulty was involved in implementing, or necessarily even be- 
lieved in, the project. Some admitted that it is possible for 
someone to not put forth the work and still reap the benefits 
of the changes that are occurring. But no one suggested that 
this was sufficient reason to abandon the project or coerce a 
colleague. There were also recurring statements that indi- 
cated that some teachers felt that some of the things that 
have been precipitated by the project would have happened 
eventually anyhow. They saw the project as a means of ac- 
celerating some things because their importance became 
deariy recognized. 

Past skepticism was seen as a necessary part of the pro- 
cess. Few believed that the project would be able to deliver 
the kind of results it seemed to promise and are proud and 
happy to have been proven wrong. They referred often to 
initial FEARS about the project; the COMMITMENT of 
time and effort it would require, the hesitancy to CHANGE 
established patterns and practices and above all, the level of 
ACCOUNTABILITY that is so obvious, fine-tuned, and on- 
going. 

One day, as I explored the work of a correlate team with a 
teacher, I shared with her my overwhelming feeling that ev- 
erything I was hearing had led me to believe that if one 
were to apply the process of the project to a marriage, a 
family, or a business — that too would become more success- 
ful. We both agree that what was being taught then, BY 
teachers an^* ^ '^R students, was really a PLAN FOR LIFE! 

Perhaps that why the quality of life in Spencerport's 
school buildings seems so positive and productive today. 
There is something good happening there for everyone 
(Werth, 1988). 



Influence of the Effective Schools 
Process Upon Program Components 

Curriculum 

**How can you do district-wide curriculum projects 
if the emphasis of an Effective Schools process is 



upon individual buildings?** is a frequently asked 
question. In 1981 Spencerport implemented a long- 
range plan for systematic curriculum study and re- 
newal. This plan established district committees, pro- 
cesses, and timelines for the study and improvement 
of each curricular area. Consequently because of this 
plan and efforts which preceded it, prior to the start 
of Spencerport's More Effective Schools/Teaching 
Project there were district curriculum guides for each 
of the major curricular areas. 

Since the project started, the timelines for the long 
range curriculum plan and the More Effective 
Schools/Teaching Project have run on parallel tracks. 
Wh?^e buildings work on installing the correlates, 
each district subject-area curriculum planning com- 
mittee reviews and revised the K-12 curriculum. Be- 
cause the process calls for considerable systematic di- 
alogue, feedback, and evaluation over an extended 
period of time between the curriculum planning com- 
mittee and the faculties in each building, teacher im- 
plementation of tcvised curricula is a smooth, effec- 
tive process. This process is summarized below. 

Year 1 — Program Presentation 

The curriculum planning committees for subject 
areas make presentations to the administration council 
and to the board of education on the major historical 
moveirents in the subject areas both locally and na- 
tionally since 1945, how the current instructional pro- 
gram for the subject area is organized and taught, and 
the results of the current evaluation data. 

The purpose of these presentations is not to say 
"These are our needs.'* The purpose of these presen- 
tations is to discuss with key audiences **What is (for 
example) mathematics education in Spencerport as 
viewed by mathematicians?*' These teaching presen- 
tations serve as an extended anticipatory set for the 
extensive needs assessment work which will com- 
mence the next year. Another purpose is to provide 
(or require) the curriculum planning committees with 
the opportunity to become thoroughly acquainted with 
what is occurring in the district prior to embarking 
upon a needs assessment. 

Year 2— Needs Assessment 

A traditional needs assessment of the strengths and 
weaknesses of the curricular area is conducted. Rec- 
ommendations for improvement emanate from this 
needs assessment. 

During the summer following the needs assess- 
ment, a team of representative teachers from through- 
out the district meets to consider the results of the 
needs assessment, the latest changes in State Educa- 
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tion Department syllabi, and current and emerging 
trends in their subject area. Using these data, the 
committee either develops a new curriculum guide for 
the district's teachers to use or revises an existing 
curriculum guide. 

Year 3— Introduction to the Staff 

Meetings are held with principals, faculties, and/or 
departments to review and discuss the content of the 
new curriculum guide. Staff development is designed 
to assist teachers in implementing the guide. Depend- 
ing upon the complexity of the topics, a few short 
sessions or an extended year-long inservice for the 
new curriculum might be needed. Materials requisite 
to implementing the guide are identified and ordered. 

If these steps are omitted, if a district moves im- 
mediately from curriculum writing to full implemen- 
tation, massive indigestion can result. Teachers might 
well feel that something is being **shoved down their 
throats." This used to occur in Spencerport. With ea- 
gerness **to get on with it," **to see results," teach- 
ers and administrators skipped the orientation phase. 
The analysis of the symptoms caused by skipping the 
orientation phase led to the development of the long- 
range curriculum plan. 

Year 4 — Pilot Implementation 

If the orientation phase requires only a short lime- 
line, then pilot implementation can occur during year 
4. After the introduction to the staff (Year 3) is com- 
pleted, teachers use the curriculum guide in the class- 
room. At the same time they are asked to report peri- 
odically the strengths and, more importantly, the 
problems they encounter. No matter how good a cur- 
riculum guide is, it will have problems. If teachers 
know that the problems will be identified and re- 
solved, then they are much more willing to work with 
a flawed document. Based upon the ongoing evalua- 
tion of the curriculum guide which occurred during 
the year, in the following summer the curriculum 
committee which wrote the guide meets to revise and 
improve it. 

Year 5— Full Implementation 

As can be seen, this curriculum timeline is long 
and slow because it includes a consensus-building 
process. Throughout the process it is common, and 
expected, for curriculum committee members to give 
progress reports at faculty and/or department meetings 
and to seek feedback from their colleagues. This or- 
ganized dialogue and the provision of lime for it to 
occur justifies the title of the long-range curriculum 
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plan — Considered Action for Curriculum Impiove- 
ment. 



Staff Evaluation 

The More Effective Schools/Teaching Project has 
had no impact upon teacher evaluation. Teacher eval- 
uation procedures which existed prior to the project 
are in use today. 

In contrast, the project has had a significant impact 
upon the evaluation of principals. Their job descrip- 
tions were revised to include a statement that they are 
responsible for their building becoming an Effective 
School and for having the correlates continually pres- 
ent in their school. For their annual self-evaluation, 
principals are required to emphasize the work their 
buildings have done to either install and maintain the 
presence of the correlates. This document then serves 
as the basis of the evaluation conference held with 
the superintendent and the assistant superintendent for 
instruction. This conference was moved from early 
June to mid-July so that current disaggregated data of 
student achievement and data on the presence of the 
correlates could be discussed. The superintendent's 
written evaluation presents correlate data and the dis- 
aggregated student achievement data. Appropriate 
comments are made in the narrative portion of the 
document. For some, this could be an intimidating 
process. Nonetheless, it does emphasize what the dis- 
trict values; it is data driven, and the ground rules 
are known ahead of time. 



Impact on the Way Student 
Achievement Is Measured 

Disaggregated Data 

Immediately prior to the inauguration of the proj- 
ect, the district completed an extensive 3-year study 
of all the major standardized norm -referenced tests. 
For each level and for each sub-test of each test the 
extent to which that sub-test measured Spencerport's 
intended, written curriculum was determined. Based 
upon this study, the district concluded that the Stan- 
ford Achievement Test measured Spencerport 's cur- 
riculum (Ferris, 1982). Consequently when the leader- 
ship planning team learned how to disaggregate data 
it had no qualms recommending disaggregating the 
norm -referenced Stanford Achievement data. 

Annually a report is prepared for each building 
which contains detailed disaggregated data for each 
subject and/or grade level as well as summary data 
for the entire building. This report is sent to each 

J7o 



Implementing Effective Schools— Spencerport, NY 



17S 



building prior to the time the building planning team 
meets to prepare next year's plan. Because of this re- 
port, principals and teachers look at their building and 
what they do in new ways, raising questions which 
otherwise would not have been asked. The summary 
data in the disaggregated data report for each building 
serve as the basis for the annual district evaluation re- 
port. 

Criterion-Referenced Tests 

It is often said that: **What gets measured gets 
done" or ''What gets measured gets learned.'' The 
best way to ascertain the degree of student learning is 
through criterion-referenced tests (CRT). When the 
More Effective Schools/Teaching Project started, the 
E.J. Wilson High School decided to use the New 
York State Education Department's Regents Examina- 
tion and Regents Competency Tests to measure the 
attainment of both equity and minimum academic 
mastery. This meant, however, that for the large num- 
ber of courses which did not end with either a Re- 
gents Exam or a Regents Competency Test, no testing 
device was available. Consequently, the building 
planning team for the high school decided to embark 
upon developing CRT's for all the other courses. 

The 1983-84 year was devoted to studying the fea- 
sibility of this project and to developing plans for im- 
plementing it. The team decided to offer a course in 
June 1984 on how to write skill objectives. (Efforts to 
obtain consultants to teach the course at the time 
were unsuccessful.) Subsequently the high school 
reading teacher, James Dentinger, and a high school 
assistant principal, Edward Groszewski, organized and 
taught the course. One resource which was a great 
continuing help was the Handbook of Formative and 
Summative Evaluation of Student Learning (Bloom, 
1979). Following this course, summer curriculum time 
was provided for writing skill objectives. 

As teachers wrote their skill objectives and at- 
tempted to develop mid-term and final examinations 
based on them, it became clear that they needed in- 
struction and/or review regarding the construction of 
test materials. Consequently a second course was or- 
ganized to teach teachers what a test matrix is, how 
to construct one, how to apply various levels of 
Bloom's taxonomy, and how to incorporate curricular 
content to a test matrix. This course was first offered 
in the late spring of 1985. Once again summer curric- 
ulum time was provided to write CRT's. 

During the 1985--86 school year each CRT that a 
teacher wrote was reviewed relative to how well it re- 
flected the curriculum for the course, the extent to 
which the various levels of Bloom's taxonomy were 
used, and the extent to which the exam reflected its 



test matrix. Additional opportunities were provided 
for training in writing skill objectives and developing 
test matrices. At the end of the school year more 
summer curriculum time was provided. 

At about the same time the New York State Edu- 
cation Department, as a part of the Board of Regents 
overall effort to improve educar^on statewide (called 
the Regents Action Plan), decided to change the re- 
quired syllabi for many courses. This meant that 
Spencerport teachers either had to write new CRT's 
and/or that the overall CRT project timeline had to be 
modified to reflect the scheduled state -wide imple- 
mentation of the new syllabi. 

Through the 1985-86 school year, faculty partici- 
pation in this project was voluntary. Even so, a ma- 
jority of the teachers took the proffered training, 
wrote skill objectives, test matrices, CRT's, and then 
reviewed them with the high school reading teacher. 
But as the 1986-87 school year commenced, the 
building planning team decided that to ensure consis- 
tent curriculum alignment it was necessary for all 
teachers to participate in the project. Consequently 
when the members of the building planning team met 
with the superintendent of schools, they asked him to 
issue a mandate that every teacher whose course did 
not end with either a Regents Exam or a Regents 
Competency Test must have his or her CRT's written 
by a certain date. (When have you ever heard of a 
group of teachers asking for a mandate from the su- 
perintendent? He responded in the affirmative — 
gladly.) 

In addition to providing curriculum time to assist 
the teachers during the summer of 1985 and 1986, 
paid time during school year vacations was provided, 
thus breaking new ground for the district. During the 
summer of 1987 the high school prepared a CRT con- 
struction manual to assist teachers (Dentinger, 1987). 
It was being revised and expanded during the summer 
of 1988, By June 1987 CRT's were offered in all des- 
ignated high school courses. The 1987-88 school year 
was devoted to further refining these tests. Disaggre- 
gated analyses of student achievement are computed 
from results of this testing. A similar project to de- 
velop CRTs for each subject area is underway at Cos- 
grove Junior High School. 



Impact of the Project on Staff 
Development Programs 

After a school begins an Effective Schools project, 
teachers ask, "What does this project mean to me?" 
"What can I do in the classroom to achieve the 
project's goals?*' Sometimes they phrase their ques- 
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lions in terms of the correlates which describe an Ef- 
fective School where all children learn. Teachers ask: 

If high expectations for success of all students is a goal, 
what can I do in the classroom to achieve this? 

If mstructiona] leadership is a characteristic of an Effec- 
tive School, how can I be more of an instructional leader in 
the classroom? 

If frequent monitoring of student progress is a correlate 
of an Effective School, how can I more effectively diagnose 
students' work and evaluate curriculum? 

Classroom teachers wonder how to translate the 
Effective Schools Research into practice. A staff de- 
velopment program based upon the effective teaching 
research helps answer their needs. Staff development 
is the "how to" of an Effective Schools project. It 
gives teachers a research foundation upon which to 
base their instructional decisions so that more effec- 
tive teaching will occur. Effective teaching research 
shows teachers how their behavior enhances learning. 

This type of staff development program differs 
from the all-too-common one-shot inservice days 
which often are of the **listen and then go back and 
do as I say" design. Oftentimes teachers attend these 
sessions with little idea of how or where it fits into 
their classroom, building, or district. These inservice 
sessions typically are short, not necessarily job-re- 
lated, and do not contain a follow-up component 
(Scaburn and Sudlow, 1987, pp. 1-3). 

Four major staff development programs were inau- 
gurated by the district as a result of the project. They 
dealt with the Hunter model, teacher expectations, 
discipline, and the research on Effective Schools. 

Elements of Instruction 

This program, based on the Madeline Hunter 
model of the teacher as a decision-maker, is an inten- 
sive 5-day workshop for teachers and an intensive 11- 
day workshop for principals and supervisors. The 
administrators' workshop includes 6 days devoted to a 
model of clinical supervision which may be used to 
assist teachers in implementing various components 
of the elements of instruction. 

The Elements of Instruction workshop reinforces 
and strengthens skills which teachers intuitively know 
are effective by giving them the research-based ratio- 
nale for their behavior. It also emphasizes research re- 
garding how children learn and translates this re- 
search into teaching practices. Extensive; time is 
provided the practice the skills taught. 

Ninety percent of the K-12 faculty have voluntar- 
ily taken this program. About half of this group have 
taken subsequent workshops designed to reinforce and 
strengthen skills they acquired (or reviewed) in Ele- 
ments of Instruction. 
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TESA (Teacher Expectations 
and Student Achievement) 

During a 7-session, once a month program, partici- 
pants in TESA are taught to distribute fifteen specific 
supportive and motivating behaviors equitably among 
the students in a class. TESA helps to make teachers 
aware of the unconscious discriminatory interactions 
they exhibit betweeu their perceived high achievers 
and their perceived low achievers. The rationale for 
TESA is that teachers can directly affect the quantity 
and quality of students* learning by the expectations 
they hold for pupil performance and how they mani- 
fest these expectations. Between sessions, teachers 
observe one another practicing the behaviors; then 
they discuss what they learned at the beginning of the 
next session. Fifty-nine percent of the K-12 faculty 
has participated in the TESA staff development pro- 
gram. 

Assertive Discipline 

The concepts of behavior modification and rein- 
forcement techniques appropriate to the classroom 
and to the building are developed in this scries of 
workshops. Two buildings, the Wilson High School 
and the Town Line Elementary School, have imple- 
mented this program. One building, the Bernabi Ele- 
mentary School, has partially implemented it. 

Effective Schools Research 

An annual workshop is held for new building plan- 
ning team members and for current members who 
wish to refresh their knowledge. The Elements of In- 
struction program was first taught by Ernest 
Stachowski, retired Director of Professional Develop- 
ment for hong Beach, California. His workshops were 
offered to all school districts in the Board of Cooper- 
ative Educational Services (BOCES). 

As a part of this program. Dr. Stachowski offered 
a scries of workshops to prepare teachers and admin- 
istrators to become qualified Elements of Instruction 
trainers. Spencerport created the full-time position of 
Instructional Specialist for Staff Development and 
sent her, Mrs. Bonnie Seaburn, to these workshops. 
To become a qualified trainer she participated in over 
50 days of formal training. In effect her first 6 
months on the job was an in-house sabbatical, fi- 
nanced by the district, to become a qualified trainer. 

This extensive training is essential for the quality 
and the success of an Elements trainer. Once Mrs. 
Seaburn completed this training she offered the basic 
elements course and elements follow-up courses. She 
also developed a long-range staff development plan 
which was reviewed by a representative group of 
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teachers, the administrative council, and approved by 
the board of education (Seaburn and Sudlow, 1986), 
When Mrs. Seaburn left the staff development posi- 
tion to become an assistant principal at the high 
school, the district once again provided a 6-month in- 
house sabbatical for her successor, Mrs. Marjoiie 
Perez, to maintain the quality of the program. 

TESA workshops are led by the instructional spe- 
cialist for staff development and other Spencerport 
teachers who attend to TESA trainer workshop of- 
fered through Phi Deha Kappa. The local trainers 
helped make the training work. 

The cost for the staff development program essen- 
tially consists of the salary and fringe benefits of an 
experienced teacher. In addition, the 1988 district 
budget included approximately the following sums to 
support the programs; 

Staff Development Budget 

Inservice Training— Teachers $14,500 
Inservice Contractual 2,300 
Inservice Supplies 2,500 

$19,300 

In 1985 Spencerport received a **special com- 
mendation" from New York State's Commissioner of 
Education, Gordon M. Ambach, for its staff develop- 
ment program. 



Other Developments Pertinent 
to the Project 

At lunch one day Ron Edmonds said, **Spencer- 
port is going to become famous." We thought, 
** You're crazy! We're a small school system in west- 
ern New York unknown to the state, let alone the na- 
tion. All we want to do is to see if this research will 
help us." But Ron was right. 

Three years into the project, after the basic home- 
work was done, Spencerport sponsored the first State- 
wide Effective Schools Conference in New York 
State. Approximately 75 attended this well-received 
conference. 

In February 1987 New York State's Assistant 
Commissioner of Education, Bruce H. Crowder, and 
his staff visited — and probed — the Spencerport dis- 
trict. They visited classrooms; they met with building 
plrnning teams; they did not talk with the district of- 
fice. On the basis of this visit plus (no doubt) other 
data, Dr. Crowdcr organized a major state-wide 
awareness conference on Effective Schools Research 
and its implementation. The Commissioner of Educa- 
tion, Gordon Ambach, was the keynote speaker. A 
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member of the New York State Board of Regents, the 
deputy commissioner, two assistant commissioners, 
key members of the New York State Education De- 
partment, and key educators from throughout the state 
were present. The Spencerport district was the only 
model featured at this 4-day conference. In July and 
December of 1986 and in July and November 1987, 
the department sponsored additional Effective Schools 
awareness conferences featuring the Spencerport 
model. Approximately 1,600 New York State educa- 
tors attended these conferences. In addition, 250 com- 
pleted one of two 5-day Effective Schools facilitators 
training workshops sponsored by the State Education 
Department. These workshops were designed to teach 
people how to implement the Effective Schools 
model. A survey in the spring of 1988 revealed that 
by the end of 1987-88, approximately 114 districts 
(out of 771) throughout the state have initiated an Ef- 
fective Schools project. Further, implementation of 
the Effective Schools Research has become a major 
thrust of ten Boards of Cooperative Educational Ser- 
vices (BOCES) and for the five regional managers of 
the State Education Depaitment's Effective Schools 
Consortia Network. The network has developed nu- 
merous publications and several Effective Schools 
needs assessment instruments and assists school dis- 
tricts embarking upon Effective Schools projects. 

The New York State Education Department (SED) 
also reprinted and widely distributed Spencerport's 
Effective Schools resource notebook. Sharing a 
Shared Vision of School Improvement, Spencerport 
has been featured in Effective Schools conferences 
held in Pennsylvania, Michigan, Illinois, Wyoming, 
Arizona, Iowa, and New Jersey. Spencerport person- 
nel have given invited presentations at annual confer- 
ences of the Association for Supervision and Curricu- 
lum Development^ the American Association of 
School Administrators, and the National School 
Boards Association. 

This extensive visibility has had a major impact on 
the district. So many come to visit the project that the 
district had to organize visitors' days. These visits 
make some feel like they are *iiving in a fishbowl." 

In July 1987 Deputy Commissioner of Education 
Gerald Freeborne and Assistant Commissioner of Ed- 
ucation Bruce Crowder invited Spencerport to apply 
to be validated by the State Education Department's 
Transferring Success Program. This program is the 
state version of the National Diffusion Network. Vali- 
dation is a long, arduous, thorough, highly profes- 
sional process. One out of every two applicants is not 
validated. Spencerport's project was validated in May 
1988. 

When Richard Egelston, on behalf of the depart- 
ment, presented a certificate to the board of educa- 
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lion, he said that no applications **have been more 
complex than this and it (the Spencerport project) has 
become a very great priority in the SED office." He 
further noted that Spencerport's More Effective 
Schools/ Teaching Project is **one of the few projects 
I have encountered in all my years with the Depart- 
ment that backs with resources the issues it believes 
to be important ... to break old habits with new 
learning and to translate educational research into 
tools for teaching in the classroom." Spencerport is 
the first school district in New York State to receive 
validation for a district-wide (K-12) project. All other 
projects the State Education Department has validated 
have been for specific areas of the program, such as 
middle school career education ("Spencerport 
Schools Get Project Award," 1988). 

Problems Encountered 

Resistance to a new program is common. **Is this 
another fad?" **Wait for a year or two and it will go 
away." **1 am suspicious of anything which the dis- 
trict office initiates." Trust. Credibility. Apprehension 
of something new. These were key problems when 
the project started. 

These problems were overcome in a number of 
ways. When the project was presented to the board of 
education for approval the board agreed that it would 
receive priority funding for the next three years. This 
sent a strong, clear signal to administrators and teach- 
ers. How many projects does a board fund so far in 
advance? Further, as staff needs for time and re- 
sources emerged, support was provided. An excellent 
staff development program to help teachers learn and 
implement new research supported by released time 
or paid summer inscrvice days also helped develop 
trust and credibility. 

The Effective Schools process essentially asks 
teachers and principals to work together in a new 
way. They are asked to form a cohesive team that re- 
quires collegial problem-solving. They must work on 
key issues that affect the quality of education and life 
in the building. Central office administrators assumed 
that somewhere in their careers, teachers and adminis- 
trators had acquired and mastered good group dynam- 
ics skills. This was not the case. Teams needlessly 
stumbled and were inefficient because they did not 
have these skills. But somehow they "muddled 
through." As the teams saw the process start to work, 
as they saw it gradually improve life in the building 
and student achievement, they were encouraged to use 
it even more. 

When starting school improvement, building plan- 
ning teams did not always know how to analyze the 
needs assessment data and develop a plan. This was 
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solved in the second year of the project when Dr. Pat- 
rick Proctor from the Connecticut State Education De- 
partment taught the teams how to perform this task. 
The teams subsequently developed and refined this 
process even further. 

About the third year into the project it was evident 
that many new building planning team members were 
unaware of the research. They possessed only surface 
awareness and knowledge. Consequently they were 
having problems developing and implementing mean- 
ingful projects. This problem was solved by annually 
conducting a ** review of the research" workshop for 
new building planning team members and for current 
team members who wished to refresh their knowl- 
edge. 

Advice for Schools Initiating 
School Improvement 

The Spencerport case suggests several things: Go 
slowly, do thorough planning, and pay your dues up 
front. Hasty planning = rough implementation; con- 
versely, extensive planning = smoother implementa- 
tion. The flowchart and suggested timeline for a proj- 
ect (Figure 1) should be useful, but modified to meet 
local needs. 

Many assume that because school improvement is 
schooi-based and that because school improvement 
occurs one school at a time, all action should be at 
the building level. Yet a building is a part of a larger 
complex social organization called a district which 
has its own unique ways of encouraging, discourag- 
ing, rewarding, punishing. If a project starts and lives 
only at the building level, its long-term, multi-year 
presence and success is far more likely to be depen- 
^.nt upon the stability and leadership of the principal; 
it is Jess likely to be institutionalized into the life of a 
school. Many such projects cease to function when 
the principal leaves. 

It is commonly assumed that bottom-up planning 
by teachers is essential to start a project. Yet a recent 
summary of four large-scale multi-state school im- 
provement studies reported that: 

There is a great need for initiation, leadership, commit- 
ment, and management by top administrators. While belief 
that cliange would only "bubble up" from the bottom held 
sway for many years, recent studies find that central leader- 
ship can help and indeed may be critical. Without central 
leadership schools* efforts to change arc less, successful. 

Teacher involvement in the specifics of planning and im- 
plementation is important, but teachers do not need to be di- 
rectly involved in initiation. 

Good programs arc essential. Successful school improve- 
ment initiatives install proven programs that meet local 
needs. It is more important to use a validated program than 
to develop a new program (Anderson, 1987). 
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Other common findings of these research studies 
which jre worthy of careful attention by those plan- 
ning to initiate a school improvement program are: 

Fidelity of implementation, especially for validated pro- 
grams, is essential. Downsizing programs during implemen- 
tation reduces the difficulty of change, but blunts the impact. 
All pieces of a program must be implemented if the program 
is to be effective. Pressure for fidelity, accompanied by as- 
sistance, Is a powerful ingredient of a successful school im- 
provement. 

Mastering new practices takes time, but it is mastery that 
leads to commitment. Commitment builds gradually but so- 
lidifies at the end of the process, when teachers and adminis- 
trators can use new techniques with relative ease and see 
their effects on students. 

Change is usually an incremental process that is strength- 
ened by initial and continuing success. These successes help 
develop and maintain commitment. 

The most successful school improvement activities target 
core elements of education, improved student achievement, 
better curriculum, and greater instructional effectiveness. Ac- 
tivities on the periphery have less impact and generate less 
interest. 

Whether improvements begin with a focus on individuals 
(training in effective instruction, for example) or school-wide 
improvements (creating the characteristics of Effective 
Schools, for example), when successfully implemented, they 
affect both individuals and schools (Anderson, 1987, pp. 80- 
81). 

Based upon research, experience, and observations 
of other districts, Spencerport administrators and 
teachers strongly recommend that a school improve- 
ment process based upon the Effective Schools Re- 
search start with the formation of a district-wide lead- 
ership planning team composed of representatives 
from all key constituencies in the district. This team 
should receive, as a group, thorough training in the 
Effective Schools Research and various recommended 
procedures for implementing it. The team then should 
prepare a master plan to be submitted to the superin- 
tendent and to the board of education for formal ap- 
proval. 

Teachers are peers and colleagues. This, however, 
does not automatically mean that teachers and admin- 
istrators possess small group dynamics skills such as 
consensus building, conflict resolution, and so forth. 
These skills are not a part of teacher preparation pro- 
grams. If Spencerport were to begin again, the district 
v-ould provide group process training for building 
planning teams. All of the teams successfully com- 
pleted their work — but with more effort and more 
emotion than was needed. Indeed one team almost 
failed because its m'^.mbers, as a group, cither did not 
possess or did not use small group process skills. 

One type of training that was most helpful was a 
workshop on how to analyze data from a needs as- 
sessment instrument (which measures the presence of 
a correlate) and then develop a building plan based 
upon it. The first year the tCv^ms struggled because 
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this was not done. This workshop was offered the 
second year of the project and many still regard it as 
a highlight. 

Training workshops for facilitators for new build- 
ing planning teams conducted by Spencerport person- 
nel routinely offer several pieces of advice to con- 
sider in selecting projects for the first y-ar of a 
project. 

• Pick a project(s) which can be completed during 
the year and will have visible success. It can be as 
simple as painting the walls of the faculty room. 
As Americans we need to see in a reasonable pe- 
riod of lime that something works, that the new 
building planning team has clout. 

• I>on*t pick for the first year a project which is 
long, complex, and will require several years to 
complete, such as writing criterion-referenced tests 
for all the courses in the high school. 

• Choose a project which is directly related to what 
the needs assessment data show. For example, if 
the data indicate a major problem with arithmetic, 
don't propose to solve it by installing content area 
reading. Because building planning team members 
have pet projects and because they are well re- 
spected by their colleagues, such jumps in logic do 
occur. 

• Choose a project over which the building has con- 
trol. For example, don't propose a project which 
requires the district office to form a district-wide 
committee. Inherent in the Effective Schools pro- 
cess is the basic assumption that each school has 
adequate time, money, materials, and human re- 
sources to become effective. It is how the adults in 
a school choose to use their resources that deter- 
mines whether their school will or will not become 
effective. 

• It is perfectly permissible to have a plan, that is, 
not to do^ but to study and to learn what current 
research says about a topic and what the best prac- 
tices are regarding the topic. The accumulated wis- 
dom of the profession does not reside in any single 
school. Then, after the building planning team — or 
a subcommittee of the faculty — is knowledgeable 
about current research and excellent practices, de- 
velop an action plan based upon this knowledge. It 
is far more likely to be successful than one which 
is based upon the current conventional wisdom of 
the faculty. 

Awareness usually occurs only when a project 
starts in earnest. Don't assume that a one-hour faculty 
meeting or a one-day conference is all that is needed 
to provide faculties with enough knowledge and un- 
derstanding so that they can successfully plan, guide, 
and implement a project. Continuing awareness ses- 
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sions should be organized and conducted by building 
planning teams. Procedures for orienting new teachers 
and administrators should be developed. Teach the re- 
search, in depth, to new building planning team mem- 
bers annually. 

The many kinds of data generated in Effective 
Schools projects should not be used to compare one 
school to another. The important issue is whether or 
not the school is improving over time and moving in 
the direction of the desired goals set forth in the mas- 
ter plan for the district — not how does it stand in the 
American League batting averages compared to other 
schools. 



Summary 

The key features of Spencerport's More Effec- 
tive Schools/Teaching Project arc: 

• A master plan. Included in the master plan are: 

A project goal that all students regardless 
of socioeconomic status shall achieve min- 
imal academic mastery 

An annual school improvement goal 

An excellence goal for students who nor- 
mally do well 

• Annual disaggregated analysis of student achieve- 
ment 

Use of a needs assessment instrument de- 
signed to ascertain the degree to which the 
correlates that describe an Effective 
School are present in each building 

• Building planning teams in every school 

Annual review and prior approval by fac- 
ulties of proposed action plans prepared 
by the building planning team 

• An annual evaluation report detailing progress 

• Comprehensive planning which flows from the lit- 
erature on the change process (Huberman & Miles, 
1984; Loucks-Horsley & Hergert, 1985; Hall & 
Hord, 1987; Hord, Rutherford, Hurling- Austin & 
Hall, 1987) 

Spencerport recommends that all Effective Schools 
Research-based school improvement projects have all 
of the above components. About Spencerport's expe- 
rience, Lczotle and Bancroft (1985) were able to 
write: 



Spencerport's success illustrates that Effective Schools Re- 
search principles can be applied in a different context. . . . 
The program enables staff members and researchers to verify 
the Effective Schools Research model's versatility and adapt- 
ability to a broader variety of school types (Lezotte and Ban- 
croft, 1985). 
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Middle Cities in Michigan 

Became involved in Effective Schools process in 1981 



Community 

Population 

NA 

Twenty-eight urban districts 
across Michigan; with karge 
proportions of poor and/or 
minority students. Have 
enrollments ranging from 3,000 
to 30,000 students. These districts 
serve a large proportion of 
compensatory-education and 
free-reduced lunch students. No 
complete actual figures on free 
lunch are available across all 28 
districts; however of those 
reporting information, the range 
is 20 percent free lunch to in 
excess of 90 percent free lunch. 
16,230 students qualify for free 
lunch; 7,083 students qualify for 
reduced lunch. 



School District 



Enrollment 

300,000/28 districts 

Ethnic Composition 

Percent minority = 42.38 
Range is 2.8 percent 
to 99.5 percent. 

P#r Pupil Expenditure 

$2,716-$5,857 
(Average is $3,568) 



Area (In square miles) 

NA 

Schools 

Elementary schools 
Junior highs 
High schools 



404 
77 
57 



Abstract 



Formed in 1973, the Middle Cities Education 
Association (MCE A) comprises twenty-eight 
(1988-89) uiban districts in the state of Michi- 
gan. MCEA members share educational con- 
cerns associated with urban areas *Mncluding 
ways to . . . educate the large proportion of 
poor and minority children in these districts." 

This case study is particularly interesting be- 
cause it demonstrates the ie for flexibility in 
implementing the Effective Sonools process, 
without losing programmatic emphasis on the 
fundamental components of the model (I.e., 
the disaggregation and faithful interpretation of 
data ond training for principals and teachers in 
skills of instructional leadership). Middle Cities 
trainers and facilitators of necessity allowed the 
districts to implement the evolving model of Ef- 
fective Schools Research as the districts saw fit. 
In many cases during the early eighties the Ef- 
fective Schools model for school improvement 
could not be accepted in its entirety because 



of local and state, political/social constraints. 
Disaggregation of data, the data gathering 
and interpretation process which drives the 
model, was not always done in all districts, nor 
was school-based management always imple- 
mented with enough training for members of 
the building teams. (The latter was true be- 
cause the Effective Schools district model for 
school improvement was not developed well 
enough to demonstrate the importance of dis- 
trict involvement with the building teams.) 

To counter some of these concerns, Middle 
Cities formed new staff development programs 
beginning in 1987 which culminated in a Profes- 
sional Development Task Force (p. 18). These 
task forces deliberate on programs for training 
for school and teaching effectiveness, as well 
as on district and school policies and proce- 
dures to suppoit school Improvement efforts. 



Brief Overview of the Programs 

The Middle Cities Education Association (MCEA), 
a consortium of 28 urban districts in Michigan, was 
formed in 1973 as a non-profit corporation. The mem- 
bers have common educational concerns associated 
with urban areas, including ways to educate e£fec- 
tively the large proportion of poor and minority chil- 
dren in these districts. Middle Cities Education Asso- 
ciation is affiliated with Michigan State University 
and its offices are located in the College of Educa- 
tion. Member districts include Flint, Battle Creek, 
Saginaw, Ypsilanti, Pontiac, Grand Rapids, Ann 
Arbor, Bay City, Lansing, Kalamazoo, and 18 other 
cities across Michigan. Collectively, these districts en- 
roll over 300,000 students or about 18 percent of the 
K-12 population in Michigan. 

Tlie Middle Cities Education Association Effective 
Schools programs were initiated in June of 1981 
when invited member district superintendents met 
with Ron Edmonds and Larry Lezotte for a two-day 
seminar to review the research on Effective Schools 
and consider possibilities for having MCEA districts 
serve as pilot sites to implement the research in Mich- 
igan. After that seminar planners developed a six-day 
workshop scries in 1981-82 for five-person teams 
each consisting of the superintendent, assistant super- 
intendent for instruction, director of evaluation, a 
principal, and a teacher. The workshop series was de- 
signed to initiate a pilot program in one school from 
each district. That program was an important step to- 
ward increasing the knowledge of the Effective 
Schools Research and planning process in member 
districts. Participants, however, perceived the need for 
more training on the meaning of the correlates, partic- 
ularly the correlate of the principal's role as instruc- 
tional leader. 

To respond to this need, C. Robert Muth, executive 
director of MCEA, and Lynn Benore, an MCEA staff 
member, developed proposals based on Effective 
Schools Research and effective teaching research to 
enhance elementary principals' leadership skills. The 
W. K. Kellogg Foundation funded the developm'^;nt of 
a three-year program (September 1983 to September 
1986) for all elementary principals from six MCEA 
districts and three small non-MCEA districts near 
Battle Creek. Due to financial limitations, one-third of 
the principals were to take part in the program for 
three years (Group I) and the rest of the principals 
were to begin in 1984, the second year of the project 
(Group II Principals). The U.S. Department of Educa- 
tion gave a similar grant from the Fund for the Im- 
provement of Post-Secondary Education (FIPSE). 
This program covered two years (1983-1985) and in- 
cluded one-fourth of the elementary principals from 
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17 MCEA districts. All of those principals were in 
that program the entire two years. In all, approxi- 
mately 150 principals and 150 lead teachers took part 
in these intensive programs. 

The first year of both projects was devoted to 
training in the essential elements of effective instruc- 
tion (Madeline Hunter model) so that principals could 
acquire stronger instructional skills. Although back- 
ground on Effective Schools Research concepts and 
the school improvement planning process were intro- 
duced in the first year, major emphasis on develop- 
ment of the school plan did not come until the second 
year. Therefore only one year was available to FIPSE 
project principals and to Kellogg Group II principals 
to learn about and write school plans based upon Ef- 
fective Schools Research. 

At the conclusion of the elementary project, mem- 
ber districts asked to have MCEA assistance in mov- 
ing the school improvement program to the secondary 
level, and again with W. K. Kellogg Foundation (in 
1987) and nPSE (in 1985) funded MCEA proposals 
for this training. The focus of the training changed 
from developing instructional leadership skills of 
principals to developing the capacity of building- 
based teams to lead programs of school improvement 
based upon Effeciive Schools Research, As a result, 
the secondary programs included training of 5- to 10- 
person teams from 26 secondary schools in the FIF^YL 
project and 15 secondary schools in the W, K. Kel- 
logg project. The training of these teams is taking 
place over a three-year period. 

Though MCEA received outside funding to initiate 
both the elementary and secondary project, the in- 
kind contributions of member districts have met or 
exceeded that external funding. External sources 
funded a full-time project coordinator, consul- 
tants/presenters, and costs for training materials. Dis- 
tricts that have participated in the programs have been 
required to pay for all other project costs such as 
overnight charges, meals, and travel costs for partici- 
pants; released time; and related in-district support to 
accomplish project goals (i.e. providing assistance to 
teams with data collection and analysis, in-district in- 
service costs for school staffs, allocation of time for 
district staff members to coordinate the program). In 
the case of the FIPSE Secondary School Improvement 
Project each district was also required to pay a sub- 
stantial registration fee yearly to cover costs of pro- 
gramming not covered by external funding. 

The purpose of outside funding has t)een to gel the 
Effective Schools program underway in each of the 
MCEA districts, with the expectation that districts 
would develop ways to continue to support the effort 
in the future. Because of the scope of the projects, 
covering 26 districts, the level and kmds of internal 
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support have varied, but all districts have continued to 
support the programs to some degree once external 
funds were terminated. In some cases the support has 
included the reallocation of at least one central office 
staff member's time to focus on Effective Schools 
Research implementation in the district. Some dis- 
tricts have a separate evaluation department that is re- 
sponsible for analyzing and providing schools with 
disaggregated student achievement data, some a!;sist 
in administering and scoring of faculty needs asfiess- 
ments. The Middle Cities organization is currently 
emphasizing a greater district role in the improvement 
process, including assisting member districts in devel- 
opment of district-wide plans if they are not currently 
in place. 



Evidence of Improvement 

Since 1981, MCE A has developed a series of four 
multi-year training programs for member districts. 
The two elementary programs ended in 1985 (FIPSE) 
and 1986 (Kellogg), while the secondary programs 
are still in process. The most extensive evaluation 
was conducted through the Kellogg elementary school 
principals* improvement program. Most of the evi- 
dence cited in this section comes from that program. 

Achievement: An Analysis of Achievement 
Data in MCA/Kellogg Project Schools 
(Group i) 

The achievement test results reported here are 
based upon school summary data for the Michigan 
Educational Assessment Program (MEAP) Test in 
schools that were participants in the MCA/Kellogg 
project between 1983 and 1986 (Kellogg I schools). 
Tne results reported are for the fourth grade at 21 
schools. (It should be noted that the three non-public 
schools were not included in the an^^^ysis because 
they do not administer the MEAP test. Four other 
public schools that participated in the Group I ses- 
sions do not have a fourth grade. During the project, 
one school wiih a fourth grade reorganized and incor- 
porated two other schools' classes, so that school was 
not included.) The results compare fall 1983 data 
(prior to the project) with fall 1986 data (at the con- 
clusion of the project). Results arc reported by the 
percentage of students in the fourth quartile, which is 
defined by the State of Michigan as the mastery level. 
The analysis of data is reported in three ways: 

1. Identification of groups of schools that demon- 
strated improvement and identificalion of groups 
that declined. 
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2. An analysis of the differences between the State 
of Michigan average scores and the average 
scores of Kellogg I schools. 

3. A disaggregated analysis based upon the catego- 
ries of free/reduced and paid lunch students for 
the years 1983 and 1986 in eleven schools. 

In the first analysis, schools were categorized by 
whether they demonstrated growth in percent of stu- 
dents in the fourth quartile between 1983 and 1986. 
Those results are as follows: 

• Thirteen buildings improved in both reading and 
math. 

• Three buildings improved in reading or math, with 
no change in the other area. 

• One building improved in reading or math and de- 
clined in the other area. 

• Four buildings declined in either reading or math, 
or both areas. 

In the second analysis the average change in the 
percent of students in the fourth quartile for the State 
of Michigan was compared to that of the 21 Kellogg 
schools a weighted proportion of students demonstrat- 
ing mastery was calculated. To arrive at that average 
the number of students in each school taking the test 
was .nultiplied by the percent tha* attained mastery 
(fourth quartile); those figures were summed across 
schools then divided by the total number of students 
that took the test in those 21 schools. 

Traditionally, urban schools (Middle Cities Educa- 
tion Association districts) have fallen below the state 
average for both reading and math at fourth grade 
level. However, between 1983 and 1986 that gap has 
been narrowed by 43 percent in reading and 5 percent 
in math for these project schools. While the average 
percentage of students attaining mastery state-wide 
has risen between 1983 and 1986, the average gain 
for these Kellogg project schools has been greater 
than that of the state. In 1983 there was a 5.8 percent 
gap on the reading test between the State of Michigan 
average and the 21 project schools; by 1986 that gap 
was 3.3 percent. In math the gap had been lessening 
each year, going from 4.4 percent in 1983 to 3.3 per- 
cent in 1985, but moving back lo 4.2 percent in 1986. 
The actual results are as shown on the next page. 
(Table 1) 

In the third analysis, fourth-grade MEAP results 
for Kellogg I schools were also disaggregated by 
free/paid lunch for 11 of 21 schools for which MCEA 
staff had completed pupil-by-pupil data from fall 
1983 through fall 1986. Ten other schools either did 
not have available all individual pupil test results for 
the four years or were lacking complete free lunch in- 
formation for those years. The disaggregated analysis 
of MEAP data for those eleven schools with complete 
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Reading (Percent Mastery Students in Fourth Quartile) 


State 




Kellogg 1 Schools 


GAP 


1983 
1984 
1985 
1986 


75.9% 
77.7% 
79.3% 
80.3% 


70.1% 
73.0% 
75.1% 
77.0% 

Math (Percent Mastery) 


-5,8% 
-4.7% 
-4.2% 

-3.3% 


State 




Kellogg 1 Schools 


GAP 


1983 
1984 
1985 
1986 


80.5% 
82.6% 
83.6% 
85.0% 


76.1% 
78.3% 
80.3% 
80.8% 


-4.4% 
-4.3% 
-3.3% 
-4.2% 



Table 2 

Disaggregated Analysis of Fourth Grade MEAP Scores 1983-1986 
11 of 21 Kellogg i Schools 





Free 


Reading 
1983 


Paid 


Free 


Math 
1983 


Paid 


4th Q 
1st Q 


66.5% 
6.4% 




75.7% 
5.1% 


Ati-, Q 
1st Q 


69.6% 
5.2% 


78.4% 

2.0% 






1986 






1986 




4th Q 
1st Q 


70.7% 
4.3% 




87.4% 
2.1% 


4th Q 
IstQ 


78.2% 
1.4% 


86.2% 
0.4% 



data reveals that the percent of free lunch students 
and the percent of non-free lunch students achieving 
mastery (defined as those in the 4th quartile) rose in 
both reading and math at those 11 schools between 
1983 and 1986. The number of students in the lowest 
category of achievement (1st quartile) fell signifi- 
cantly for both free and non-free lunch students. The 
table above indicates the degree of change for the 11 
schools in the 4th quartile, and the change in percent 
of students in the 1st quartile, or lowest level of 
achievement, between 1983 and 1986. (Table 2) 



Connecticut School Effectiveness 
Questionnaire 

Early in the first year (1983-^4) of the W. K. Kel- 
logg Elementary Project each principal was required 
to conduct a building-wide needs assessment to deter- 
mine the extent to which the seven correlates of Ef- 
fective Schools already existed, as perceived by the 
building staff. They used the Connecticut School Ef- 
fectiveness Questionnaire^ a 73-item questionnaire 
that was administered to all teachers and other in- 
structional support staff. These questionnaires were 
computer-scored at Michigan State University and re- 
turned to the building administrators. With few cxcep* 
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Tables 

Kellogg 1 Schools: Connecticut Quex 



Correlate 1983 1986 Change 



Safe & orderly 



environment 


3.9 


4.0 


+0.1 


Clear school 








mission 


3.4 


3.8 


+0.4 


instructional 








leadership 


3.2 


3.5 


+0.3 


High expectations 


3.4 


3.8 


+0.4 


Time on tasl< 


3.6 


3.7 


+0.1 


Frequent monitor 








of pupils 


3,7 


3.9 


+0.2 


Home-school 








relations 


3.4 


3.6 


+0.2 



tions the schools complied with the administration of 
the Connecticut School Effectiveness Questionnaire at 
the start of the project. 

The original project design also required all build- 
ings to readminister the Connecticut School Effective- 
ness Questionnaire at the conclusion of the project, 
but during the course of the program it became evi- 
dent this would not be appropriate for all schools. 
Some schools had not had an opportunity to imple- 
ment fully the programs they had planned as of spring 
19rt6 when the project ended. In several cases 
changes in principals created concern about adminis- 
tering a needs assessment when the new principal had 
not yet had time to make a difference. Thus, all 
schools were asked lo either readminister the Con- 
necticut School Effectiveness Questionnaire in spring 
of 1986 or to provide a written rationale indicating 
why it would not be appropriate at that time and to 
tell when it would be read ministered. By the fall of 
1986 project staff received results on the 
readministration of the Connecticut School Effective- 
ness Questionnaire from 19 of 29 schools in Group I 
of the Kellogg elementary program. The pre-project 
and post-project analysis is reported here. (Table 3) 

The analysis of the Group I schools includes 15 of 
the 19 schools that readministered the Connecticut 
School Effectiveness Questionnaire in spring 1986, 
Four schools were not included in the analysis be- 
cause they used different instruments originally or be- 
cause they used a form of the Connecticut School Ef- 
fectiveness Questionnaire different from the rest of 
the group. The teaching and instructional support 
staffs in 15 schools perceived pasitive changes in v '1 
seven correlate areas. The results are reported on a 
five-point Likert scale, with one (1) indicating little 
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or no presence of a factor and five (5) indicating a 
high level of that correlate. 

The areas of high expectations, clear school mis- 
sion, and principal's instructional leadership demon- 
strated the most gains during the life of the projec* 
but gains were registered in all seven areas. 

Progress on School Improvement Plans 

One goal of all four funded projects was comple- 
tion of a school improvement plan based on the Ef- 
fective Schools and effective teaching research and 
during the projects participants learned about phases 
in its development. MCEA project staff requested par- 
ticipants to send parts of their plan to Middle Cities 
as it was completed. 

As of June 30, 1986, the project staff received 
complete school improvement plans from 21 of the 29 
buildings in Group I (principals in the program three 
years) of the Kellogg elementary schools project. The 
project received completed plans from 26 of the 48 
buildings in Group II (principals in the program for 
two years) of that project. Most other buildings in 
boih groups I and II sent the project staff data in one 
or more of the four categories in which we requested 
information: improvement team members, missions 
statement, disaggregated analysis of achievement, 
school plan. Those data reflected their involvement in 
the process as of the conclusion of the project. Three 
buildings in Group I and nine buildings in Group II 
did not send any data. Of those 12 non-respondents, 
one principal was newly assigned to a building in 
1985-86 and in four other buildings the principals 
were retiring in June of 1986, which may indicate 
problems with level of commitment to the program. 

In some instances the project staff was aware that 
data existed at the building, but that it was not sent to 
MCEA. For example, one school district runs a disag- 
gregated analysis achievement for each of its schools. 
But not every school forwarded that analysis to the 
Middle Cities office. 

Considering the time restrictions and work in- 
volved, variations in district and school environments, 
and the degree of individual motivation and commit- 
ment, the MCEA was satisfied with the response to 
the Kellogg elementary improvement project. Sev- 
enty-six percent of Group I principals and 54 percent 
of Group II principals sent completed school improve- 
ment plans. Only 15 percent of the schools in the 
project did not submit planning data. 

Evidence of District Initiatives 

Over the past seven years more emphasis has been 
placed on improving the instructional programs and 
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student outcomes in most member districts. When 
many districts hire new teachers and principals, inter- 
views now focus primarily on candidates' ability to 
successfully respond to questions of an instructional 
nature with special attention given to research on ef- 
fective teaching and Effective Schools. Candidates for 
principal in particular are expected to demonstrate 
knowledge of Effective Schools and teaching research 
and to understand the impact of long-range planning 
on student achievement. 

Boards of education in several districts are aware 
of the role of the instructional leader and some now 
emphasize those skills when interviewing candidates 
for superintendent. Some of the districts routinely 
have Effective Schools/school improvement agenda 
items at board meetings, including review of s:udent 
data and presentations by school teams on their goals 
and written plans. 

Though time constraints continue to be present, 
several districts have provided significant released 
time to improvement teams, especially in the i'-jtial 
planning stages Some high schools in current IvlCEA 
projects have given one or two team members an ad- 
ditional planning period to coordinate the Effective 
Schools program. Already available staff development 
days are being used more frequently for activities as- 
sociated with school improvement plans instead of the 
more traditional **one-shot" presentation on a variety 
of topics. Most buildings have also inc:orporated items 
related to the Effective Schools planning process into 
their regular staff meetings. Some districts have spon- 
sored multi-day instructional skills training programs 
for teachers and administrators, often during the 
school day, or with stipends outside of school hours. 
Even in districts that offered intensive staff develop- 
ment opportunities after school or during the summer 
without stipends, the cost of the program itself was 
borne by the district. 

Several districts now routinely have central office 
personnel disaggregate norm -referenced test and 
Michigan Educational Assessment Program test data 
for all schools in the district. More districts are mov- 
ing in that direction. Assessment personnel work with 
individual schools to interpret results and use the data 
in planning. Most districts or schools use either 
free/reduced lunch versus paid categories mother's 
level of education as indicators for socic.' status. 
Some also disaggregate data based on race and/or 
gender. Some school personnel have expressed a need 
for their districts lo more clearly define the curricu- 
lum and to set guidelines for mastery; in the absence 
of such district coordination, schools frequently have 
attempted to accomplish this in isolation. 

Most MCEA districts have demonstrated a stronger 
emphasis on staff development directly as a result of 



our projects. Virtually all districts have conducted 
programs of effective instruction for their administra- 
tive and teaching staffs, which require a significant 
increase in the amount of time devoted to staff devel- 
opment. Several districts have made a substantial 
commitment to having staff members become instruc- 
tional skills trainers, and some have changed the roles 
of some participants to include staff development re- 
sponsibilities. Some districts have created new posi- 
tions for directors of staff development and/or direc- 
tors of school improvement. Some districts have 
created special funds schools can use to work with 
staff in writing and implementing their improvement 
plans. At least one district requires that all requests 
for staff development time or funds be linked directly 
to the school's written improvement plan. (See **In- 
terviews with District Superintendents," page 190.) 



Changes in MCEA Practices 



Changes in Student Assessment 
Practices in MCEA 

As a result of participation in Middle Cities Effec- 
tive Schools programs, districts are more aware of the 
need to monitor more closely the progress of each 
student through analyzing disaggregated student out- 
comes data and by developing criterion -referenced as- 
sessments. This is particularly critical at the second- 
ary level where appropriate measurement of student 
outcomes is weak. Inadequate student outcome data 
makes it difficult for districts to accurately determine 
the priorities for improvement and then select strate- 
gies designed to strengthen outcomes. Without a 
range of data, disaggregated by specific subgroups of 
the student population, schools do not have a clear in- 
dicator of how well they are accomplishing their 
agreed-upon mission. To address this need MCEA has 
sponsored a series of workshops on development of 
criterion-referenced assessments presented by Dr. 
Marc Becker, director of research and evaluation and 
evaluation at the Glendale (Arizona) Union High 
School District. 

Several districts currently have limited criterion- 
referenced measures in one or two subject areas at the 
secondary level and are working on expanding the 
scope of those assessments both in terms of content 
areas covered and frequency of assessment. The di- 
rectors of research and evaluation from Middle Cities 
districts meet monthly and have discussed develop- 
ment of a bank to be accessed by member districts. In 
the current secondary school improvement pro/.cts 
some individual schools have begun the process of 
determining student outcomes of greatest importance 
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Significont Chonges: Interviow^ wtth District Superinten€ien;$ 
W. K. Kellogg Elementoiy Prihcipate' Leodership Project 



In the fall of 1986, at the conclusion of the W. K Kellogg Elementary Principals' Leadership Proj- 
ect, Robert Muth, the former executive director of MCEA, and Muskegon ^eights Superintendent 
John Sydnor, interviewed each districts superintendent to determine chani^es which resulted from 
involvement in the project included here are excerpts from six of these interviews. 

What do you believe was the most significant behavioral change resulting from 
the principals' and teachers' participation? 

The general responses of the most observable change was the increasing amount of time 
spent on school improvement discussions and planning with the building staffs. The most 
obsen/able informal change was the ability of the principals to discuss instructional change 
and instructiorial planning in their conversations with each other and with the total adminis- 
trative staff of the school district. 

There also seemed to be an increasing willingness on the part of the principals to request 
and urge additional staff training. 

At the building level the most significant total staff change was the cooperative work effort 
in developing the school mission and the school improvement plans. 

Was there a significant degree of change (increase) in the district's monetary 
commitment to professional development? 

The responses to this question were extremely encouraging to the inten/iewers. Every par- 
ticipating district had made contributions to a broadened professional development program. 
To most, this involved extending the training of effective teaching to many additional mem- 
bers of the teaching staff and to bringing in consultants for training in such programs as 
TESA (Teacher Expectations and Student Achievement) and Assertive Discipline. The direct 
monetary contributions from the districts ranged from $10,000 from the smallest district to 
$50,000-^60,000 in the larger districts. This cost did not Include the indirect costs of 
teacher participation such as stipends for summer or weekend training. The managerial and 
fiscal support given to expanded professional development is a very concrete measure of 
the value of the project. 

In addition to the fiscal support for expanded programming, the districts, of course, contrib- 
uted substantially in sut>stitute pay, travel, lodging, and meals for the participants in the 
project training. There Is no doubt that districts made a greater contribution to professional 
development through this project than was anticipated when they began their participation 
a^, in some case$» probably greater than they ever contemplated could be possible. 

have goals been established for improving student aohievement? 

Although all superintendents Indicated their personal goals for improving student achieve- 
ment, only one district was a^le to cite specific goals and measurable objectives for improv- 
ing student achievement. In discussing the responses to the question, the interviewers were 
of the belief that until computerized data management systems were more readily available, 
student achievement goals would t>e more general than specific. But there was no doubt 
that Improved student achievement was a primary school management goal. All school dis- 
tricts do spend considerable time in the analysis of the MEAP test data, including an item 
analysis which Identifies areas of needed instructlonai emphasis* 
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and considering ways to develop criterion-referenced 
measures within the school when their districts are 
not yet prepared to do that district-wide. MCEA sees 
the development of such assessments as a priority in 
its future professional development activities. 

Changes in Professional 
Development Programs 

As an organization, MCEA has significantly 
changed its approach to staff development as a result 
of its involvement in programs of school improve- 
'^lent based upon Effective Schools Research. The 
central thrust of professional development in MCEA 
since 1981 has been implementation of the Effective 
Schools Research model at the elementary, secondary, 
and district levels. MCEA projects have evolved from 
programs intended to improve individual performance 
(i.e., teacher effectiveness training for individual 
teachers and instructional leadership training for prin- 
cipals) to programs intended to improve organiza- 
tional functioning. MCEA now works primarily with 
building-based and district improvement teams to as- 
sist them in moving through the steps in the school 
improvement process and to help them promote colle- 
giality and communication throughout the school and 
district organization. 

In addition to offering long-term programs on the 
Effective Schools improvement process, MCEA pro- 
vides related programs for training in areas such as 
implementing the research on teacher effectiveness, 
developing criterion-referenced assessments, and 
using the research on effective staff development. For 
example, superintendents and other central office per- 
sonnel from member districts met in two-day semi- 
nars in the summers of 1985 and 1986 as well as five 
days of training during the 1985-86 school year to 
learn more about specific steps in the school improve- 
ment process, long-range strategic planning, how to 
implement a program of instructional skills training, 
and the requirements of effective staff development 
program design, implementation, and evaluation. 

As a result of these school improvement projects, 
the Middle Cities Education Association initiated dur- 
ing the 1986-87 school year a Professional Develop- 
ment Task Force which has become an ongoing part 
of the organization. Middle Cities has 14 task forces 
that are made up of central office administrators who 
meet monthly in key educational areas such as the In- 
structional Task Force (directors of instruction or cur- 
riculum), Personnel Task Force (directors of person- 
nel), and Research and Evaluation Task Force. An 
important issue the Professional Development Task 
Force has considered is the design and implementa- 



tion of appropriate policies and programs for staff de- 
velopment based upon the research. 

An advisory committee on MCEA professional de- 
velopment activities, made up of directors of profes- 
sional development and assistant superintendents for 
instruction, has strongly recommended that the focus 
of MCEA programs continue to be on implementation 
of Effective Schools Research and/or programs di- 
rectly related to the research that enhance districts' 
capacities to deliver appropriate educational strategies 
within their improvement plans. These include coop- 
erative learning, TESA, organizational change and de- 
velopment, team-building, criterion-referenced assess- 
ment, goal setting. 

Components of the Effective Schools 
Planning Process In MCEA 

The major emphasis of Middle Cities in the Effec- 
tive Schools Planning Process since 1981 has been to 
assist individual buildings in developing long-range 
plans. The planning process has consisted of the fol- 
lowing steps: 

1. gain an overview of the Effective Schools pro- 
gram for building administrators 

2. select school teams 

3. provide inservice to teams on the effective 
schools research and planning process 

4. develop school mission 

5. select student outcomes that measure progress 
toward the mission 

6. gather and analyze student outcomes data 

7. administer and analyze the faculty needs assess- 
ment and archival information 

8. select priorities for improvement goals based 
upon the needs assessment and student data 

9. write the three- to five-year improvement plans 
10. implement and evaluate. 

Within each project there have been district re- 
quirements for general support to the project schools, 
chiefly in the forms of financial and time commit- 
ments, as well as a commitment by each district to 
continue adequate financial support to the buildings 
once the projects have been completed. MCEA*s new- 
est project, the W. K. Kellogg Secondary School Im- 
provement Project, gives strongest emphasis yet to as- 
sisting district improvement teams. 

Through the Instructional Task Force, Professional 
Development Task Force, Evaluation Task Force, and 
periodic meetings with all MCEA superintendents, the 
MCEA staff has over the past seven years reviewed 
the improvement process followed by t!ie school 
teams and has made central office adninistrators 
aware of specific forms of district support important 
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to success. These meetings have included discussions 
of the need for curriculum alignment and criterion- 
referenced assessment in each local district, the need 
for adequate district-supported staff development pro- 
grams designed to enhance the improvement process 
in the schools, the need to collect and disaggregate 
student outcomes data district-wide, and the need to 
provide better services to the school in terms of data 
analysis and uses of that data to improve the school's 
instructional delivery. 

Though many districts have improved their support 
to the school-based teams in one or more of the areas 
described above, only a few of the districts have de- 
veloped district-level teams and a district plan of im- 
provement based upon Effective Schools Research. 
Through its professional development division MCEA 
is presently considering a comprehensive training 
model for district teams in writing long-range district 
improvement plans that support and complement the 
individual building plans. 

Problems/Issues/Concerns 

Though the Middle Cities Education Association, 
which serves 28 urban districts, must handle a variety 
of if^ues in different districts, common areas of con- 
cern are detailed here. These are areas to be ad- 
dressed during the process. 

A major concern has been with a philosophical 
commitment to district support of programs once proj- 
ect funds were concluded, particularly in districts 
without district-'*yide plans. MCEA has been success- 
ful in getting commitment to Effective Schools Re- 
search implementation from most districts in part due 
to the ongoing communication of the MCEA office 
with the superintendents, including several multi-day 
workshops beginning in 1981, and interviews con- 
ducted with each superintendent during the project. 
Although MCEA has not progressed as far as it 
would have liked in promoting a district as well as 
building planning processes for members, the superin- 
tendents and boards have actively encouraged the as- 
sociation to continue working with individual build- 
ings and to move from the elementary to the 
secondary school level. 

Strong indications of district commitment to con- 
tinuation of programs at the school level can be seen 
in the secondary school improvement projects. As the 
FIPSE Secondary School Improvement Project was 
originally funded it allowed for eight districts to be a 
part of the program. MCEA superintendents asked the 
project staff to find a way for 19 districts to partici- 
pate, even though that required a substantial yearly 
registration charge. Both the Kellogg and FIPSE Im- 



provement Projects require attendance of building 
teams in a workshop series during a three-year period, 
which is a substantial increase in district financial 
commitment over previous projects in which only 
principals were asktd to participate. 

A second concern is district financial planning to 
continue programs, particularly when so many dis- 
tricts are in urban areas with limited resources and 
high unemployment. Many districts have had severe 
budget cuts, and are presently facing even more, but 
in several districts there has been an emphasis on 
continuing to make Effective Schools programs a fi- 
nancial priority. For example, one superintendent re- 
cently said that maintenance of highly professional 
personnel with time to work collaboratively on ap- 
proaches to improve pupil performance is at the heart 
of the school organization, and that core value will be 
protected even though budget reductions may be 
needed in the system. Districts have looked carefully 
at available resources to determine ways to more ef- 
fectively use funds to promote and maintain school 
improvement, though most need even more assistance 
in lining up budget allocation priorities with instruc- 
tional priorities related to Effective Schools. 

A third concern surfaced when MCEA began 
working at the secondary schools level. Project con- 
sultants, staff members, and some superintendents an- 
ticipated a high degree of reluctance or skepticism on 
the part of secondary school faculty because most ex- 
isting research was conducted at elementary level. 
Also, the more departmentalized, autonomous nature 
of secondary schools makes collaboration for change 
more difficult. This concern was not as critical as first 
anticipated, due in part to the involvement of all 
school team members throughout the training. Most 
teams were receptive to learning about the research. 
Skepticism on the part of some members at the begin- 
ning of the project lessened considerably as the team 
progressed through the program. Secondary school 
teams found it to be particulariy helpful to share 
progress and problem-solving strategies with other 
urban districts. 

Not yet met is an overall need for better team 
communication with the rest of the faculty as well as 
their involvement. The size, organization, and culture 
of most secondary schools makes such involvement 
difficult, and consequently, the reluctance of other 
staff members to commit to the program may result in 
part from a lack of understanding of the change to be 
accomplished. Faculty members who have not had the 
opportunities that teams have had to thoroughly learn 
about the Effective Schools Research need to learn 
about the improvement process. 
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Conclusions and Recommendations 

Over the seven years that Middle Cities Education 
Association has sponsored school improvement pro- 
grams based upon Effective Schools Research, MCEA 
has modified several aspects of the training. This sec- 
tion briefly highlights key areas of modification as 
well as suggestions for those who are initiating pro- 
grams. Those highlights and suggestions include: 

• Plan for inservicc follow-up before the program 
begins. Assigning well-qualified facilitators to each 
school and/or district team is important to success- 
ful follow-through on concepts and activities pre- 
sented at workshops. Facilitators should schedule 
regular visits to the school teams. 

• Set clear program goals and expectations of par- 
ticipants at the beginning of the project or program 
so that everyone knows for what they are **signing 
on.** 

• Provide a high quality orientation to building and 
district leaders to lay out the premises of the Ef- 
fective Schools Research and the steps in the plan- 
ning process. Leaders must understand the **big 
picture" and the beliefs upon which the model is 
based. Leaders should also be guided on appropri- 
ate selection criteria for school improvement teams 
because the membership of those teams is critical 
in accomplishing the planning tasks and in getting 
the rest of the faculty to buy in to the program. 

• Conduct most training with the entire team to 
ensure adequate communication and understanding 
of key concepts and planning activities. Working 
with principals in isolation puis a tremendous bur- 
den on people who are already overloaded; the in- 
volvement of the entire team in the training sends 
the clear message that al) of the faculty shares re- 
sponsibility for improvement as well as creates the 
opportunity for principals to learn how to involved 
other faculty members in shared decision-making. 

• Assign a team member to serve as "point** per- 
son whose major responsibilities include making 
sure the whole team is knowledgeable and uses in- 
formation in specific areas. Key planning and re- 
search areas needing a point person are: gathering 
and analyzing student outcomes, organizational 
change research, and research on effective staff de- 
velopment. 

• Educators, especially those at the secondary level, 
need intensive training and support to develop and 
effectively monitor student outcomes data. 

• Beware of the tendency for teams to focus on 
"doing something about the correlates'' without 



ever paying attention to student outcomes. The 

correlates are only a vehicle toward the real goal 
of improved student performance; they should be 
viewed as inputs or strategies to help reach the 
goal of improved student outcomes. 

• To avoid having correlate improvement become 
the major goal, gather and analyze the student 
outcomes data prior to administering the correlate 
assessment. State all long-range improvement 
goals in terms of student performance indica- 
tors. The correlate assessment may then be used to 
develop strategies to move you toward your im- 
proved student performance goals. 

• A critical part of the early planning for schools 
and districts should include reassessing current 
time commitments and priorities so that time is 
made for school improvement activities. The dis- 
trict organizational patterns should be looked at 
closely early in the process so that time is used in 
the most focused and effective manner, and to en- 
sure that the time used for school improvement 
programs is built into the organizational calendar, 
and is not viewed as an **add on" or voluntary. 

" School improvement teams need to select at least 
one short-term goal that can be accomplish even 
before the plan is written. This gives them the 
chance to work cohesively and to demonstrate 
quickly to the rest of the faculty that changes can 
be accomplished. When teams wait until the entire 
plan is written before implementing any aspects of 
it, they often become frustrated and their peers 
question the purpose of the team. 

• Make available scheduled opportunities through- 
out the year for all school teams from a district to 
meet with each other to share concerns and prog- 
ress. The superintendent and district team should 
also meet with the teams several times to enhance 
communication and demonstrate support. 

• In projects such as the MCEA-sponsored programs 
that involve several districts, teams from various 
districts meet regularly together to share progress 
and learn from each other. 

• Though effective-teaching training models are im- 
portant in building instructional leadership skills, 
start the program with a framework of Effective 
Schools Research. After the SI team has written 
the improvement plan, effective-instruction training 
can be added as a strategy within the plan. At- 
tempting io introduce Effective Schools and effec- 
tive-teaching research simultaneously proved con- 
fusing and too overwhelming a task for most 
participant? -n earlier projects. 
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In the preceding chapters the reader was presented with series of **portraits'' of local schools as 
they have implemented and continue to implement programs of school improvement based on the Effec- 
tive Schools Research. Each of the districts portrayed in the case studies was asked to organize their 
story from an outline that was provided. (See Appendix A & B.) 

The outline was not designed to constrain the authors, rather it was intended to direct the authors 
to those questions most frequently asked by both researchers and other practitioners. The outline also 
allowed us to **look across the cases'' for the lessons that have been learned through those experiences. 
These case studies have retained the authors' styles and tell the stories as they were perceived to have 
occurred by those directly involved. They represent portraits of improvement from the view of the prac- 
titioners who daily faced the challenges of school improvement. The case studies are truly examples of 
work in prqgress and therefore any lessons learned might be thought of as **craft knowledge" about the 
school change process. 

The good news seems to be that certain identifiable trends appear and, for the most part, these 
trends tend to parallel the findings reported in the school-change literature (See the Introduction). While 
the trends are not exhaustive they do allow others to have greater confidence in the Effective Schools 
Research, to proceed with programs of school improvement based on it, and most importantly, to in- 
crease their sense of efficacy about successfully planning and implementing their own program of 
school improvement based on the research. 

Perhaps the proper context for describing the trends that emerge in the cases is to point out that in 
each case study, certain Effective Schools concepts provided the underlying structure for the school 
improvement process. The themes tend to be those most frequently associated with the Effective 
Schools Research. They include a focus on quality and equity, on seeking observable or measurable 
results, on the school site as the critical unit for the ongoing change process, on the empowerment of 
school-based professionals for the purpose of taking charge of change, and on data-driven monitoring 
and analysis of current organizational functions. The reader should also notice that no two schools or 
districts addressed these themes in precisely the same way. In other words, there are many variations on 
these themes, and it is through the local process of adaptation that each district and individual school 
develops the ownership and commitment necessary to initiate and sustain this long-term and incremental 
process. 

What are the lessons to be learned from the analysis of the case studies? 

Lesson 1. Planning and implementing programs of school improvement does not follow a rec- 
ipe or formula. 

Local schools or districts that may contemplate using the ESR framework to guide this school 
process must recognize that the ESR framework is neither a project" nor a **program." Rather, it is 
better viewed as a process, a way of thinking about and looking at our schools as changing and change- 
able organizations. This means that it cannot simply be implemented as a pre-packaged program" as 
has been so often alleged by many of the critics of the Effective Schools process. 

Lesson 2. School improvements based on Effective Schools Research has been successfully 
demonstrated in a variety of organizational settings. 

One of the more powerful statements that can be made about the ESR framework after one reads 
the case studies is the generalizability of the ESR framework. In the early years, a common criticism of 
the Effective Schools Research was that it was conducted mainly in urban elementary settings serving 
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concentrated populations of poor and economically disadvantaged minority students. This led many of 
the critics to conclude that the process of school improvement based on the research would only be 
possible in those settings. These case studies clear away that erroneous notion. Some cases talk about 
large school districts that are urban, often poor and minority, and others describe suburban, almost 
rural, non-disadvantaged districts. The cases described programs that have worked in lower as well as 
higher achieving districts. They speak about successful change in elementary, middle, and high school 
settings. They speak about all regions of the country: North, South, East, and West. It would be hard to 
imagine after reading these case studies, districts where the ESR framework would not be relevant. 

Lesson 3* The participating districts have outcome evidence to substantiate their claims that 
their schools ano' the district are improving* 

In soliciting the case study materials each author was expected to provide evidence that students 
were, in fact, the beneficiaries of the school improvement effort and not merely the teachers or adminis- 
trators. Like the model itself, the evidence of results comes in many forms. Some districts have relied 
heavily on standardized, norm-referenced measures of student achievement, at the same time acknowl- 
edging the limitations of such measures. Others have focused on state-wide, criterion-referenced mea- 
sures because of political considerations and because the districts could align their instructional pro- 
grams to these measurements more easily. Some districts found it more desirable to develop their own 
curriculum-based, criterion-referenced measurement system to augment the other systems already in 
place. However, all districts measured student performance. 

Measurement issues are of major concern in education in the United States today. The Effective 
Schools-based districts seem to be a little ahead of some in coming to terms with the complexity of the 
issue. These case studies illustrate that those educators recognize the power that is conveyed in the 
concept '*what gets measured gets done" in a complex organization. These districts are well aware of 
the limitations of measuring only basic and lower-level skills. They are addressing this concern by fac- 
ing head-on the development of higher-level teaching and seeking additional assessment strategies. 

The case studies describe districts and schools that have the courage to * 'confront** the measure- 
ment issues. They are striving to instill in their districts the following tenet: for schools to become 
effective and remain so, teachers must believe in their head, heart, and **gut** that if they teach the 
intended curriculum and the students learn it, the students will do well on the measures of achievement. 
Teachers in most schools today do not share this belief, and as a result, institutional anxiety is severe 
and pervasive. The schools that are implementing the Effective Schools framework are a bit closer to it 
and are therefore leading the nation. 

More than anything else the Effective Schools framework requires schools and districts to assume 
ownership of student achievement and the problems that go with it. The case studies describe a set of 
districts which have stopped blaming low achievement on the low achiever. The empowerment that 
serves to sustain the Effective Schools process often comes when the participating schools see that they 
can achieve greater success for more of their students if they are committed to doing so. 

Lesson 4* While school improvement occurs school-by-school and one school at a time, sup- 
port from a central office (that itself is restructured toward school improvement) significantly 
increases the likelihood of sustained positive change* 

In varying ways, each case study verifies Ronald Edmonds* belief that when it comes to school 
improvement, there are no unimportant adults in the organization. Early attempts to bypass the central 
office and local board of education proved to be an unintended mistake. These cases illustrate the 
power of total organizational alignment toward the overall organizational mission of teaching for learn- 
ing for all. Probably the single most revealing indicator of total integration of the organization for 
school improvement is the level of direct and active involvement evidenced by the superintendent. A 
second powerful indicator relates to school board and community involvement. The extent to which 
policies, resources, and program evaluation discussions begin to focus on the issue of more effective 
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schools and school improvement inoicates how soon the culture of the organization will begin to shift 
toward the aims and purposes stated in that mission. 

Additionally, the cases suggest the need to decentralize decision-making and move closer to a 
site-based management model. The evidence indicates that this management strategy will serve the in- 
terests of school improvement if, and only if, principals and school-based collaborative groups of teach- 
ers are properly trained to function in this manner. As suggested by the cases, the cost of successfully 
implementing this process is not excessive. However, all available staff development resources need to 
be harnessed and channeled to assure maximum impact. 

Lesson 5. Ultimately, personnel evaluation systems must be aligned with the values of the 
school improvement program and they should be growth-oriented. 

Several case studies show that changes in the way central office, principals, and even the superin- 
tendent were evaluated called into play the values inherent in the Effective Schools process. For obvi- 
ous reasons, one cannot expect people to take risks and behave differently if old systems and outdated 
criteria are used to evaluate staff and administrators. Perhaps the place to begin this alignment process 
is to alter the basis on which the superintendent is evaluated by the board of education. In several cases, 
it was clear to all that superintendents had deliberately *'put themselves on the line" on behalf of 
school improvement. When this happens everyone in the organization realizes that school improvement 
is "real." As more superintendents are hired to lead school improvement and as more are let go be- 
cause they cannot lead school improvement, a whole new set of norms, beliefs, and expectations will 
develop. 

Lesson 6. Teacher improvement can work if the mission is clear and If time and other re- 
sources are available to support school-based planning and training processes. 

The most frequent concern expressed by teachers is the lack of time available for school improve- 
ment. In the case studies, the issue of time was always in the background. The best results were real- 
ized when the board of education made the hard decision to allocate resources to support school-based 
planning and staff development time. When one tries to alter the actions and behaviors of an organiza- 
tion as complex as a school, allocating resources for retraining becomes essential to program success. 
The case studies reflect the lesson we all need to learn from our private sector colleagues: improvement 
and change are not free; maintaining the status quo is free because the forces of institutional inertia will 
tend to have us repeat past behaviors. Change is deliberate, technical, and consumes time and other 
resources. On the other hand, no school district reported spending more than one percent of its re- 
sources on the improvement process — a real bargain indeed. 

Lesson 7. Perceptional surveys of the characteristics of Effective Schools when coupled with 
other indicators of strengths and weaknesses provide a valid basis for school-based planning and 
school improvement. 

When the faculty of a school has been appropriately oriented regarding Effective Schools research 
and when they understand how school-based data are to be used to promote improvement, they seem 
able and willing to provide honest assessment of the school's strengths and weaknesses. Each of the 
case studies used some type of data-gathering instruments to inform the building level planning process. 
While the surveys were similar, each district tended to fine-tune" an instrument to its own contexi. 
Again, this process tends to increase understanding and commitment to the results which flow from its 
use. 

Two points should be stressed. First, the particular survey and other data-gathering strategies 
should remain true to the Effective Schools Research and not simply represent the beliefs of someone in 
the research office. Second, the data should not be used in a mechanical way, rather these survey data 
need to provide the basis for both reflection and sustained discourse before conclusions are drawn. 
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Lesson 8* Schools and districts need to explore more and better ways of bringing research 
into the school*based discourse on school improvement* 

In the case studies, the participating districts were challenged to be creative in thinking about effi- 
cient and effective ways of informing school-based practitioners of their research findings. One limita- 
tion of the school-based model is that school improvement teams often have difficulty looking beyond 
their own experiences in formulating an action strategy to respond to an identified need. Though collec- 
tive experience is often powerful enough to solve the local problems of a school, new ideas from re- 
search should be an integral part of the discussion process. Make no mistake, research does not improve 
schools — people do. At the same time those people have an obligation to themselves as professionals to 
review continually research and practice related to what works in teaching their students. 

Lesson 9. School improvement is a complex and ongoing process that requires patience and 
persistence. 

The case studies indicate that there are few, if any, quick fixes when it comes to enduring school 
change. Staff members need to be mentally prepared for the *Mong haul/' otherwise they will become 
discouraged quickly. A strategy that seems to help involves celebrating small successes at both the 
school and district levels. People need to realize that progress is being made even though larger, longer- 
term goals may still be some distance away. In education, we often do not recognize the impact that 
celebrations can have in sustaining the effort and to maintaining the focus around the core values asso- 
ciated with school improvement. 

Lesson 10. The Effective Schools process works best when schools and districts disaggregate 
and publicly display their student performance data* 

These districts emphasized repeatedly the need for disaggregating measured or observed student 
outcome data. This process differs from place to place, but when it is done and discussed it forces 
institutional attention to be directed toward the issues of equity. Publication of outcomes makes it diffi- 
cult to ignore the mission of teaching for learning for all. 

We are learning more about the processes of working efficiently and effectively with student per- 
formance data. As we gain more experience we will be able to streamline the procedures by taking full 
advantage of computer technologies that are already available. 

The key to the success of this analysis process is to choose performance indicators (See Appendix) 
that accurately reflect the core values of the organization. Too often, data are extensively analyzed be- 
cause they are available, not because they are "carriers of the values" of the schools. It would be 
better to focus on fewer and even less refined measurements if the ones selected are closer to the vital 
signs — values — of the organization's culture. 



Summary 

These ten lessons are illustrated across the case studies. The National Center for Effective Schools 
Research and Development has as one of its goals not only to continue to monitor programs in these 
districts, but also to add new districts to the *'data base'' for our applied research on planned change. 
As more is learned, we believe we can make a significant contribution to school improvement by help- 
ing others to apply this knowledge to their own processes of school improvement based on the Effective 
Schools Research process. 
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Accountability: The shared responsibility of the educational community (district and schools) to 
teach all children and be held to specific valid and reliable measures and standards of student perfor- 
mance outcomes. If all students are to succeed at the next level of study, they must be required to 
obtain certain knowledge and skills, agreed upon by teachers and administrators, and supported by par- 
ents and citizens. The locus of responsibility for successful academic achievement of all students is with 
the teacher. The principal and district need to support the classroom teacher in his or her efforts and 
they all should be held accountable for results. 

Active learning time, time-on-task^ engaged time, allocated time: These terms refer to time 
spent by students in classrooms interacting with each other and/or their teacher in didactic activity. The 
following figure illustrates the relationship of these concepts: 




After Harnischfeger and Wiley, 1981 and Berliner, 1984. 
€> National Center for Effective Schools Research and 
Development and Barbara O. Taylor, Ph.D. 



Allocated time is that time scheduled each day for a learning unit or activity. Time-on-task 
is that amount of time students are actually working on or thinking about the subject matter 
and the understanding it may require. In the graph, allocated time and time-on-task are shown 
not to be directly proportional at all times. This is because teacher variables and student vari- 
ables interact to preclude a relationship which is always symmetrical. The same asymmetrical 
relationship is obviously the case for allocated time and timc-on-task, and a greater discrep- 
ancy in proportion can be present. Engaged time is the period of time where student concen- 
tration is intense and the possibility for learning and acquisition of skills is greatest. Active 
learning time is that portion of time when actual learning and/or acquisition of knowledge 
and practice of skills is taking place. 
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Assertive discipline: A discipline plan that requires students to match their behavior to a set of 
rules predetermined by the school faculty and individual teacher and posted in the classroom. The pro- 
cess provides due process as well as emphasizing the importance of reinforcement of acceptable behav- 
ior, (see Lee Canter, Educational Leadership, October 1988.) 

At-risk students: Students who, often because of a disadvantaged (i.e. multi-problem family, pov- 
erty, child abuse, drug abuse) background, tend to fall behind in basic skills and studies, and have a 
high probability of dropping out of school by ninth or tenth grade. Often defined by educators to in- 
clude those students who are two years behind in reading by the sixth grade (Kyle, 1985), and/or who 
have high absentee rates and low grades in second, third, and fourth grade (Hess, et al., 1989). The later 
attributes together (low grades plus absenteeism) predict with .90 accuracy that the student will drop-out 
in high-school. 

Baseline data: 'Tre-test'' or pre-intervention data: Outcome measurements gathered at the begin- 
ning of the school improvement process against which future outcome data can be compared. Also used 
in Effective Schools planning at school and district level. 

Bloom's Taxonomy: Benjamin S. Bloom's two-volume Taxonomy of Educational Objectives, 
(McKay, 1974) was designed to 1) describe thinking skills from lower level comprehension or recall to 
higher level thinking skills of analysis, synthesis, and evaluation, and 2) describe affective educational 
objectives. This was the first time an educational researcher had made a comprehensive taxonomy of 
educational objectives, and these two volumes are now classics and universally referred to. 

California Achievement Test (CAT): This test, the Stanford Achievement Test, and the Iowa 
Test of Basic Skills are the three most widely used standardized, norm-referenced achievement tests for 
assessing student performance in the United States. 

Comprehensive assessment: A complete evaluation or appraisal of educational outcomes of 
teaching-learning criteria, program criteria, or policy criteria. Used to determine the state of educational 
quality and equity in these categories in order to make decisions at the classroom, school, or district 
level. The criteria and standards (level of accomplishment in each criterion) should be agreed upon by 
teachers and administrators before the comprehensive assessment takes place. 

Comprehensive Test of Basic Skills (CTBS): A standardized norm-referenced achievement test 
given in elementary and secondary schools. 

Cooperative Learning: A cooperative learning group usually consists of two to five students who 
work together for a common purpose — to complete a task and to include every member of the heteroge- 
neous group. This program was authored by David W. Johnson and Roger T. Johnson and is taught in 
staff development programs. 

Correlate assessment: Perception data usually provided from questionnaires/interviews that de- 
scribe the relative presence of the seven school characteristics found in highly effective schools. 
Data from these assessments are used as an information base for determining how to improve the qual- 
ity and equity of student outcomes. 
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Correlates: School characteristics that researchers have found to be present in schools that effec- 
tively teach all children. These characteristics become part of the language for carrying on the discourse 
of school improvement and include: clear and focused mission, strong instructional leadership, positive 
learning climate, high expectations for success, opportunity to learn and time on task, frequent monitor- 
ing of student performances, and positive home/school relations. 

Criterion-referenced test/CurricuIar-based testing; Criterion-referenced tests are designed to as- 
sess whether a student has mastered the taught subject matter that is specified in the written curriculum. 

Culture: The behavioral norms, organizational structures, beliefs, shared values, and attitudes of a 
school or district which distinguishes it. The culture defines **the way to do things around here.** Effec- 
tive Schools are characterized by cohesive cultural norms with the central belief that schools can create 
the conditions which promote learning of the intended curriculum by all students. 

Curriculum alignment: Through this process the written curriculum is matched to the taught-and- 
tested teaching objectives in a school, school district, or state. 

Data-driven decisions: A key premise of the Effective Schools framework which focuses on the 
use of student outcome data and correlate assessment data to drive decisions related to improvement 
activities. 

Disaggregation: A term used by researchers of Effective Schools to describe the process for ana- 
lyzing outcome data by student subgroups within a school or district (e.g., gender, socioeconomic sta- 
tus, race -ethnicity) to determine the school *s effectiveness in serving all children. 

Empowerment: The investment of authority, responsibility, information and knowledge to the 
most appropriate and effective level of decision-making. To accomplish empowerment, district and 
school professionals must be provided programs of skill development, time, and materials to do the job 
well (Kanter, R. M., 1983) (Pink, 1990, in press). 

Equity: The degree of fairness of the educational program in providing learning opportunities to 
all students, and making available and accessible the intended curriculum to all students. Equity is mea- 
sured by the disaggregated distribution of student achievement scores on tests, preferably criterion-refer- 
enced tests, as well as on other student outcome measures such as attendance, tardiness, suspensions, 
and discipline infractions. 

Equal opportunity to learn flows from these process concepts and from the content of the 
curriculum, and includes those alterable variables in classroom teaching which determine ♦he 
requisite information and skills acquired by students to achieve mastery at successive levels 
of education (Carroll, 1963; Bloom, 1%8, 1984; Harnischfeger and Wiley, 1981). 

Frequent monitoring: The frequent assessment of student academic performance through the de- 
sign and use of a timely and accurate student monitoring system to aid teachers in planning for reme- 
dial, accelerated, and enriched instruction. 
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Gates-MacGinitie Reading Test: Individual or small group reading achievement test commonly 
administered in elementary and middle schools. 

High expectations: The organizational structures of the school and the attitudes and behaviors of 
the staff that reflect a belief that all children can learn and that the staff has the capacity to teach all 
children. 

Instructional leadership: Leadership which gives direction, emphasis, and supix)rt to the schooPs 
instructional program and inspires others to work within the school's central '^teaching for learning for 
air' mission. Instructional leaders are often teachers, support staff, and central office staff as well as 
principals. 

Instructional Theory Into Practice (ITIP): Training which provides teachers and administrators 
the opportunity to review and apply researched effective instructional techniques within their classrooms 
and schools. 

Iowa Test of Basic Skills: (Similar to the Comprehensive Test of Basic Skills). See California 
Achievement Test (CAT). 

J-Curve: A mathematical expression of achievement that illustrates that most students can learn 
most things, most of the time. Unlike the traditional bell shaped curve, the J-curve shows gradations of 
student achievement, including failure, as **normal and acceptable,'' and targets areas of re-teaching for 
mastery. 

Mastery learning: A model of learning in which all but a very few students arc expected to 
achieve over time the mastery of predetermined subject matter and skills. 

Measured student outcomes: The learning behaviors and skills of students which are taught as 
the intended curriculum and occur as a result of the instructional process. Different assessment pro- 
cesses are used, including testing, to discover the extent of change (short-term or long-term) of learning 
behaviors of each student. 

Melropolitan Achievement Test: (Similar to Comprehensive Test of Basic Skills) 

Mission: A charge to a school or district. A statement of what the school/district is striving to 
become, written in measurable, observable terms which can be operationalized for planning, implemen- 
tation, and evaluation purposes. 

Restructuring: Reforming the interrelationships of an organization to achieve a stated goal. A 
strategy used to analyze and redesign the current organization, its systems, roles, and reporting relation- 
ships in order to achieve desired student outcomes. In the classroom a teacher restructures the teach- 
ing-learning process by using a variety of teaching strategies and materials, and by reallocating time in 
order to facilitate learning for all students. 

School-based management^ site-based management, or site-based improvement: A'! are terms 
which describe the governance process and procedures which make day-to-day decision-making at the 
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school building level work. School-based management (SBM) is a form of district organization and 
management in which the school and its community system is the key unit for day-to-day decision 
making and for school change and improvement. The SBM decisions are made collaboratively with 
faculty contribution, and the working structure of the school council or committee is decided upon by 
the principal and faculty, often with representation from citizens and parents. 

School community relations: The dedication of school personnel to communicate with and in- 
volve parents and the community in roles that materially affect the school's ability to teach all children. 

School improvement process: A long-term, outcomes driven and collegial process designed to 
create cultural and structural changes within the school that lead to student success. This process is 
usually led by a school improvement team which analyzes data and develops and implements an im- 
provement plan. 

School improvement team: A cross-section of personnel within the school that has been empow- 
cred to lead the improvement process and to work collaboratively with the entire staff to improve the 
conditions that contribute to student success. Part of the school-based management process, it often 
includes parent and citizen representatives. 

School learning climate: The attitudes and practices within a school that affect the overall satis- 
faction and productivity of students and staff. A positive school climate evolves from a commonly 
agreed upon school mission and is characterized as safe, orderly, and business-like, conducive to learn- 
ing and free from emotional and physical harm. 

Socioeconomic status (SES): The socioeconomic status or background from which a child comes 
may serve to stereotype the school's expectations for learning by that child, and therefore the child may 
not perform to his/her potential. In these cases the school must have a way to track outcome data of 
student performance which identifies children from low SES backgrounds. Also the school must iden- 
tify students who may lack educational resources in their homes. Ronald Edmonds' early research iden- 
tified several variables which are a school's best indicators of SES. The two most common ones used 
are the mother's educational level (Has she graduated from high school?) and eligibility for free and 
reduced lunch. SES is a key variable used for disaggregating student achievement data. 

TESA: Teacher Expectations Student Achievement: A training program to help educators to 
become aware of the research on how teacher expectations affect student achievement, and to develop 
pedagogical skills to increase teacher effectiveness in the classroom. 

Time-on-task: See Active learning time. 

Writing across the curricular program: A holistic approach to teaching writing through the con- 
text of each subject matter in the curriculum. 

Writing to Read (IBM): A computer program set up in a learning computer lab or classroom that 
allows elementary students to develop writing skills in conjunction with a total language arts approach. 
Students work individually and in small groups. 
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Appendix: A 

NATIONAL CENTER FOR EFFECTIVE SCHOOLS 
RESEARCH AND DEVELOPMENT 
2199 Jolly Road, Suite 160 
Okemos. Michigan 48864 
(617) 349-8841 

March 28, 1988 
Dear Colleague: 

As you probably know, we have been busy developing the new national Center for Effective 
Schools Research and Development. We are pleased to report that the Center is now in operation 
and has three major program thrusts: research and development, training and technical assis* 
tance, and networking and corrferencing. The purpose of this letter is to invite you and your col- 
leagues to participate in one of our exciting programs* 

A priority project of the Center is a monograph which contains descriptions of programs such as 
yours, where the effective schools process has worked. We plan to publish such a monograph by 
approximately September, 1988, We are hoping you can help us in this endeavor. 

We would like to invite you and your colleagues to tell your story and celebrate your success. 
Many school district staffs around the country will not only be stimulated by your success, but also 
will benefit greatly by usir^ your expertise to guide them through the complex processes associ- 
ated with a planned change program. 

Attached is a brief outline of the proposed monograph. We have set July 1. 1988 as the deadline 
for receiving your chapters* If you are unable to contribute to this monograph effort, please inform 
us in writing. 

The monograph will be available from the Center at cost of production. If any profit is realized, it 
will be used by the Center to support future publication. In return for your assistance, we are 
offering you or your designee an honorarium of $500 for the manuscript, or fifty copies of the 
finished monograph for you to distribute. If neither of these options seem appropriate, please tell 
us in what alternative way we may recognize your efforts. 

We sincerely hope you will be able to accept this Invitation. Other schools and various research 
projects will benefit greatly from the lessons this monograph can teach all of us. Most importantly, 
we believe that with your contributions, we will illustrate that more children are being better served 
as a resuft of the effective schools program* 

Respectfully, 



Lawrence W. Lezotte, PhD 
Director 



Beverly A. Bancroft, PhD 
Associate Director 

BAB/mja 
Enclosures 
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Tho Proposed Monograph will bo orgonizod os follows:* 

The Preface will create the purposie and context for the monograph contents. It 
will highlight featured case studies as examples of programs of school improve- 
ment based on the Effective Schools Research (ESiR) which have, over time, evi- 
denced successful results. These results have indicated measurable progress for 
growing numbers of public school students from all subsets of the school popula- 
tion. 

Chapter One will be an overview of Effective Schools Research and an analysis 
of how the Framework Is applied to programs of school Improvement. It will be 
written by Dr* L. W. Lezotte and Dn 8* A. Bancroft. 

Chapters Two through Thirteen will be individual case summaries written by pro- 
gram participants. The descriptions will generally follow the attached outline. The 
exact number of chapters will depend on the responses of school staffs who wish 
to contribute. Case summaries are to be limited to 25 pages. They should cover 
such questions as "How have the implementations and changes occurred?." "How 
have these changes affected the progress of students and the culture of the 
school?" 

Chapter Fourteen will be a summary entitled, "Reflections and Implications." It 
will outline the question "What has been learned so far from these successful pro- 
grams of school improvement?" 



^EiStors Not€: This \% the original plan for organizaUoo, The prtt^a! cdi'tora clwngcd the formal slighily Odcc the 
case studies had been anajiyzed in order to clarify and compttre the findings of tl»e study. 
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^ .y '-^y-y-'y^r:- Suggested Outline for Case Summaries 




' . ■ ; (each should be 25 pages or tess; doii ble; spaced) . 


Title: Please include the name of the school district in the title or sub-title. 


Authors: Pletase give complete criedit for authorship of this case summary to key program 




\ persohnef who contributed expertise and commitment to the program. This kind 




of credit can be included inside the case study* 


1 . Brief Overview of the Effective Scltools Program 


k 


; What are ttfe dieimographfc characteristics of the district? 




Whiftjiy^a^^^ motivation for launching the program? 




"W|WH:=WSS 


a: 


Who were t^^^^ . : 




■iri general terms, what has been the level of fundirig needed to sustain the effort? 


F. 


How has the program been supported financially, symbolically, and with professional 




timei/ovet its history? 


G. 


What hais been, and is now, the source of funding for the program, both internal or 




externaJ? (If not described before, please describe here.) 


: 2. What widernxi does the district have that the schools are improviiig? 


■ A.- 


Measured Stud 




1/ I^drm Re^^^ 




2/;Crifef:ip^^^^^ 




: 3; ;OthW^^^ Data (i;e* ^attendan^^ etc.) 


. a- 


Wifi^t do<»im^^^ In the strength and presence of the Con-elates 




of Effediive Schools? ■ • 


c. 


What other organizational or personnel related data suggest that the schools have 




improved? Use tables, charts, graphs or short descriptions to portray the findings. 
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3, How has the Effective School Process influenced the following program components? 

A. the curriculum 

B. program implementation 

C. program evaluation 

D. staff evaluation 

E position descriptions 

F. community attitudes 

G. service and funding agencies 

H. recognition of the instructional process 
I. other areas not included here 



4. How does the Effective Sctiools Process affect tt)e way student achievement is measured? 

A. disaggregated data 

B. development of curriculum-based testing 

C. development of criterion-referenced tests 

5. If professional and general staff development programs have changed or been modified as a 
result of tfie Effective Sctiools thrust, describe why and/or how. 



6. Describe the components of the Effective Schools Planning Process. 

A. Is there a district-level coordinating team? 

B. What has been the involvement of the Superintendent, Teachers. Board. Central 
Office Administrators, and Parent or Student Groups in the program? 

C. Do individual schools have school-based teams? Do they develop individual school 
long-range plans? 



7. How tias the personnel evaluation system changed as a result of the Effective Schools Pro- 
gram? 



8. What has developed in relation to the Effective Sctiools Process and not mentioned above, 
that might bear upon the following? 

A. policies 

B. procedures 

C. practices 

D. other 
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9. What problems, issues, or coricerns did your program encounter and how were they over- 
come? 

A. externa! mandates 

B. community changes 

C. budget cuts 

D. other factors 



10. If your sciiool district had it io do over again, knowing what you now know, what might you 
do differently? In other words, what advise might you give other schools just initiating school 
improvement? 



1 1 . Summary 



Note: The manuscript received will be adjusted to assure readers a similar format for the case 
summaries. The reworked draft will be forwarded to your authors for editing and approval. 
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Appendix: C 

Some Performance Indicators used by Effective Schools Districts: 

Standardized Norm-referenced Actiievement Test Scores (disaggregated) 

State-wide Criterlon-refereruied Test Scores 

District-made Criterion-referenced Test Scores 

Teacher-made (district or school-wide) Criterion-referenced Test Scores 

Advanced Placement (tiigh schools) 

Student PromotiorVRetentioh Data (disaggregated) 

Student Discipline infractions 

Student Suspension/Expulsion Rates (disaggregated) 

Vandalism Reports 

Drug and Alcohbi Abuse 

Student Attendance 

Student Tardiness 

Staff Absenteeism 

Staff Efficacy/Organizational Health/School Climate 

Staff Perceptions of School Improvement Accomplishments (Including Correlate Assessments) 
Student Drop-but Rates (high schools) 
Graduating Students' Attitudes 

Student Employment Data (while attending high school and after high school) 

Post-secondary Student Matriculation Data 

Career Objectives 

Physical Fitness of Students, Staff 

Extracurricular Activities, Student Participation 

Student Self-Esteem 

Quality and Quantity of Student Homework 
Parental Involvement 

Supporting/Empowering Organizational Structures In Place and Functioning: 

Studem Monitoring System 
Staff Development System 
Currloular Development System 
bisciplirie System 
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